2023-02-07 16:55:17,775 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-07 16:55:17,983 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7 2023-02-07 16:55:17,996 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-07 16:55:17,997 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/cluster_25d3abf0-9a4f-edc9-863c-800af9aba25c, deleteOnExit=true 2023-02-07 16:55:17,997 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-07 16:55:17,997 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/test.cache.data in system properties and HBase conf 2023-02-07 16:55:17,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/hadoop.tmp.dir in system properties and HBase conf 2023-02-07 16:55:17,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/hadoop.log.dir in system properties and HBase conf 2023-02-07 16:55:17,998 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-07 16:55:17,999 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-07 16:55:17,999 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-07 16:55:18,098 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-07 16:55:18,399 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-07 16:55:18,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-07 16:55:18,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-07 16:55:18,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-07 16:55:18,403 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 16:55:18,404 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-07 16:55:18,404 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-07 16:55:18,404 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-07 16:55:18,405 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 16:55:18,405 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-07 16:55:18,405 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/nfs.dump.dir in system properties and HBase conf 2023-02-07 16:55:18,406 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/java.io.tmpdir in system properties and HBase conf 2023-02-07 16:55:18,406 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-07 16:55:18,407 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-07 16:55:18,407 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-07 16:55:18,809 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 16:55:18,812 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 16:55:19,503 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-07 16:55:19,632 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-07 16:55:19,645 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 16:55:19,675 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 16:55:19,702 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/java.io.tmpdir/Jetty_localhost_localdomain_34689_hdfs____ce8p00/webapp 2023-02-07 16:55:19,805 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:34689 2023-02-07 16:55:19,838 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-07 16:55:19,838 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-07 16:55:20,471 WARN [Listener at localhost.localdomain/40031] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 16:55:20,568 WARN [Listener at localhost.localdomain/40031] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-07 16:55:20,588 WARN [Listener at localhost.localdomain/40031] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-07 16:55:20,593 INFO [Listener at localhost.localdomain/40031] log.Slf4jLog(67): jetty-6.1.26 2023-02-07 16:55:20,598 INFO [Listener at localhost.localdomain/40031] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/java.io.tmpdir/Jetty_localhost_45005_datanode____hox6uz/webapp 2023-02-07 16:55:20,673 INFO [Listener at localhost.localdomain/40031] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45005 2023-02-07 16:55:20,945 WARN [Listener at localhost.localdomain/41849] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-07 16:55:21,928 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xccd27381200ea0c: Processing first storage report for DS-087f676e-2dc6-4b9b-a952-e6a9ab68adfb from datanode 4dc2c340-886d-49be-bfe6-ae608d70ad78 2023-02-07 16:55:21,937 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xccd27381200ea0c: from storage DS-087f676e-2dc6-4b9b-a952-e6a9ab68adfb node DatanodeRegistration(127.0.0.1:33799, datanodeUuid=4dc2c340-886d-49be-bfe6-ae608d70ad78, infoPort=46871, infoSecurePort=0, ipcPort=41849, storageInfo=lv=-57;cid=testClusterID;nsid=476059844;c=1675788918869), blocks: 0, hasStaleStorage: true, processing time: 9 msecs, invalidatedBlocks: 0 2023-02-07 16:55:21,938 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xccd27381200ea0c: Processing first storage report for DS-811c0f6c-f64f-4d5a-b4da-0244dd4018c5 from datanode 4dc2c340-886d-49be-bfe6-ae608d70ad78 2023-02-07 16:55:21,938 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xccd27381200ea0c: from storage DS-811c0f6c-f64f-4d5a-b4da-0244dd4018c5 node DatanodeRegistration(127.0.0.1:33799, datanodeUuid=4dc2c340-886d-49be-bfe6-ae608d70ad78, infoPort=46871, infoSecurePort=0, ipcPort=41849, storageInfo=lv=-57;cid=testClusterID;nsid=476059844;c=1675788918869), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-07 16:55:21,974 DEBUG [Listener at localhost.localdomain/41849] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7 2023-02-07 16:55:22,050 INFO [Listener at localhost.localdomain/41849] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/cluster_25d3abf0-9a4f-edc9-863c-800af9aba25c/zookeeper_0, clientPort=56335, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/cluster_25d3abf0-9a4f-edc9-863c-800af9aba25c/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/cluster_25d3abf0-9a4f-edc9-863c-800af9aba25c/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-07 16:55:22,062 INFO [Listener at localhost.localdomain/41849] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56335 2023-02-07 16:55:22,069 INFO [Listener at localhost.localdomain/41849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:55:22,071 INFO [Listener at localhost.localdomain/41849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:55:22,696 INFO [Listener at localhost.localdomain/41849] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333 with version=8 2023-02-07 16:55:22,696 INFO [Listener at localhost.localdomain/41849] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/hbase-staging 2023-02-07 16:55:22,984 INFO [Listener at localhost.localdomain/41849] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-07 16:55:23,338 INFO [Listener at localhost.localdomain/41849] client.ConnectionUtils(127): master/jenkins-hbase12:0 server-side Connection retries=3 2023-02-07 16:55:23,362 INFO [Listener at localhost.localdomain/41849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 16:55:23,363 INFO [Listener at localhost.localdomain/41849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 16:55:23,363 INFO [Listener at localhost.localdomain/41849] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 16:55:23,363 INFO [Listener at localhost.localdomain/41849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 16:55:23,363 INFO [Listener at localhost.localdomain/41849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 16:55:23,475 INFO [Listener at localhost.localdomain/41849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 16:55:23,538 DEBUG [Listener at localhost.localdomain/41849] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-07 16:55:23,610 INFO [Listener at localhost.localdomain/41849] ipc.NettyRpcServer(120): Bind to /136.243.104.168:45371 2023-02-07 16:55:23,619 INFO [Listener at localhost.localdomain/41849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:55:23,622 INFO [Listener at localhost.localdomain/41849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:55:23,638 INFO [Listener at localhost.localdomain/41849] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45371 connecting to ZooKeeper ensemble=127.0.0.1:56335 2023-02-07 16:55:23,776 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:453710x0, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 16:55:23,780 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:45371-0x1013e59781e0000 connected 2023-02-07 16:55:23,897 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 16:55:23,900 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 16:55:23,906 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 16:55:23,915 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45371 2023-02-07 16:55:23,915 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45371 2023-02-07 16:55:23,916 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45371 2023-02-07 16:55:23,917 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45371 2023-02-07 16:55:23,917 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45371 2023-02-07 16:55:23,922 INFO [Listener at localhost.localdomain/41849] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333, hbase.cluster.distributed=false 2023-02-07 16:55:23,984 INFO [Listener at localhost.localdomain/41849] client.ConnectionUtils(127): regionserver/jenkins-hbase12:0 server-side Connection retries=3 2023-02-07 16:55:23,984 INFO [Listener at localhost.localdomain/41849] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 16:55:23,984 INFO [Listener at localhost.localdomain/41849] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-07 16:55:23,984 INFO [Listener at localhost.localdomain/41849] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-07 16:55:23,985 INFO [Listener at localhost.localdomain/41849] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-07 16:55:23,985 INFO [Listener at localhost.localdomain/41849] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-07 16:55:23,988 INFO [Listener at localhost.localdomain/41849] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-07 16:55:23,991 INFO [Listener at localhost.localdomain/41849] ipc.NettyRpcServer(120): Bind to /136.243.104.168:33237 2023-02-07 16:55:23,993 INFO [Listener at localhost.localdomain/41849] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-07 16:55:23,997 DEBUG [Listener at localhost.localdomain/41849] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-07 16:55:23,998 INFO [Listener at localhost.localdomain/41849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:55:24,001 INFO [Listener at localhost.localdomain/41849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:55:24,002 INFO [Listener at localhost.localdomain/41849] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33237 connecting to ZooKeeper ensemble=127.0.0.1:56335 2023-02-07 16:55:24,013 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:332370x0, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-07 16:55:24,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:33237-0x1013e59781e0001 connected 2023-02-07 16:55:24,014 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 16:55:24,015 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 16:55:24,016 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-07 16:55:24,016 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33237 2023-02-07 16:55:24,017 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33237 2023-02-07 16:55:24,017 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33237 2023-02-07 16:55:24,018 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33237 2023-02-07 16:55:24,018 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33237 2023-02-07 16:55:24,020 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:55:24,040 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 16:55:24,042 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:55:24,071 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 16:55:24,071 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-07 16:55:24,071 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:55:24,072 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 16:55:24,074 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase12.apache.org,45371,1675788922805 from backup master directory 2023-02-07 16:55:24,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-07 16:55:24,087 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:55:24,087 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-07 16:55:24,088 WARN [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 16:55:24,088 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:55:24,091 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-07 16:55:24,094 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-07 16:55:24,574 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/hbase.id with ID: 1a39fe91-c605-4d30-9fe1-a17a8fd0d0b6 2023-02-07 16:55:24,621 INFO [master/jenkins-hbase12:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:55:24,681 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:55:24,727 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x72e6f1fa to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:55:24,790 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74d67d5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:55:24,808 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-07 16:55:24,809 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-07 16:55:24,825 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-07 16:55:24,825 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-07 16:55:24,827 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-07 16:55:24,830 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-07 16:55:24,831 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 16:55:24,857 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store-tmp 2023-02-07 16:55:24,879 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:24,880 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 16:55:24,880 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 16:55:24,880 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 16:55:24,880 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 16:55:24,880 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 16:55:24,880 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 16:55:24,880 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675788924880Disabling compacts and flushes for region at 1675788924880Disabling writes for close at 1675788924880Writing region close event to WAL at 1675788924880Closed at 1675788924880 2023-02-07 16:55:24,882 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/WALs/jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:55:24,905 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C45371%2C1675788922805, suffix=, logDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/WALs/jenkins-hbase12.apache.org,45371,1675788922805, archiveDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/oldWALs, maxLogs=10 2023-02-07 16:55:24,952 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33799,DS-087f676e-2dc6-4b9b-a952-e6a9ab68adfb,DISK] 2023-02-07 16:55:24,958 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-07 16:55:25,009 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/WALs/jenkins-hbase12.apache.org,45371,1675788922805/jenkins-hbase12.apache.org%2C45371%2C1675788922805.1675788924913 2023-02-07 16:55:25,010 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33799,DS-087f676e-2dc6-4b9b-a952-e6a9ab68adfb,DISK]] 2023-02-07 16:55:25,010 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:55:25,010 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:25,013 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 16:55:25,014 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 16:55:25,063 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-07 16:55:25,069 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-07 16:55:25,089 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-07 16:55:25,099 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:25,104 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 16:55:25,105 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-07 16:55:25,120 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-07 16:55:25,124 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:55:25,125 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67642611, jitterRate=0.007953450083732605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:55:25,125 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675788925037Initializing all the Stores at 1675788925039 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675788925040 (+1 ms)Cleaning up temporary data from old regions at 1675788925111 (+71 ms)Cleaning up detritus from prior splits at 1675788925112 (+1 ms)Region opened successfully at 1675788925125 (+13 ms) 2023-02-07 16:55:25,126 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-07 16:55:25,143 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-07 16:55:25,143 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-07 16:55:25,145 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-07 16:55:25,147 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-07 16:55:25,173 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 25 msec 2023-02-07 16:55:25,173 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-07 16:55:25,194 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-07 16:55:25,199 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-07 16:55:25,219 INFO [master/jenkins-hbase12:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-07 16:55:25,222 INFO [master/jenkins-hbase12:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-07 16:55:25,224 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-07 16:55:25,228 INFO [master/jenkins-hbase12:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-07 16:55:25,232 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-07 16:55:25,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:55:25,283 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-07 16:55:25,283 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-07 16:55:25,294 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-07 16:55:25,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 16:55:25,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-07 16:55:25,308 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:55:25,308 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase12.apache.org,45371,1675788922805, sessionid=0x1013e59781e0000, setting cluster-up flag (Was=false) 2023-02-07 16:55:25,339 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:55:25,371 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-07 16:55:25,373 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:55:25,397 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:55:25,428 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-07 16:55:25,431 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:55:25,434 WARN [master/jenkins-hbase12:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp 2023-02-07 16:55:25,523 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(952): ClusterId : 1a39fe91-c605-4d30-9fe1-a17a8fd0d0b6 2023-02-07 16:55:25,527 DEBUG [RS:0;jenkins-hbase12:33237] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-07 16:55:25,528 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-07 16:55:25,536 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-07 16:55:25,537 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-07 16:55:25,537 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-07 16:55:25,537 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-07 16:55:25,537 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase12:0, corePoolSize=10, maxPoolSize=10 2023-02-07 16:55:25,537 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,537 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=2, maxPoolSize=2 2023-02-07 16:55:25,537 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,538 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675788955538 2023-02-07 16:55:25,541 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-07 16:55:25,542 DEBUG [RS:0;jenkins-hbase12:33237] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-07 16:55:25,542 DEBUG [RS:0;jenkins-hbase12:33237] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-07 16:55:25,545 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 16:55:25,545 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-07 16:55:25,550 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 16:55:25,550 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-07 16:55:25,556 DEBUG [RS:0;jenkins-hbase12:33237] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-07 16:55:25,557 DEBUG [RS:0;jenkins-hbase12:33237] zookeeper.ReadOnlyZKClient(139): Connect 0x4c2b1eee to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:55:25,557 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-07 16:55:25,558 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-07 16:55:25,559 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-07 16:55:25,559 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-07 16:55:25,560 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,561 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-07 16:55:25,562 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-07 16:55:25,562 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-07 16:55:25,564 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-07 16:55:25,564 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-07 16:55:25,565 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675788925565,5,FailOnTimeoutGroup] 2023-02-07 16:55:25,565 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675788925565,5,FailOnTimeoutGroup] 2023-02-07 16:55:25,565 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,565 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-07 16:55:25,567 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,567 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,574 DEBUG [RS:0;jenkins-hbase12:33237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@42ecf91b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:55:25,575 DEBUG [RS:0;jenkins-hbase12:33237] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46d3759e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase12.apache.org/136.243.104.168:0 2023-02-07 16:55:25,577 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 16:55:25,579 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-07 16:55:25,579 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333 2023-02-07 16:55:25,597 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase12:33237 2023-02-07 16:55:25,600 INFO [RS:0;jenkins-hbase12:33237] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-07 16:55:25,600 INFO [RS:0;jenkins-hbase12:33237] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-07 16:55:25,600 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1023): About to register with Master. 2023-02-07 16:55:25,603 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase12.apache.org,45371,1675788922805 with isa=jenkins-hbase12.apache.org/136.243.104.168:33237, startcode=1675788923983 2023-02-07 16:55:25,615 DEBUG [RS:0;jenkins-hbase12:33237] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-07 16:55:25,654 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:48161, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-07 16:55:25,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.ServerManager(394): Registering regionserver=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:25,676 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333 2023-02-07 16:55:25,676 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:40031 2023-02-07 16:55:25,677 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-07 16:55:25,692 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 16:55:25,692 DEBUG [RS:0;jenkins-hbase12:33237] zookeeper.ZKUtil(162): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:25,693 WARN [RS:0;jenkins-hbase12:33237] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-07 16:55:25,693 INFO [RS:0;jenkins-hbase12:33237] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 16:55:25,694 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/WALs/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:25,695 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase12.apache.org,33237,1675788923983] 2023-02-07 16:55:25,704 DEBUG [RS:0;jenkins-hbase12:33237] zookeeper.ZKUtil(162): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:25,712 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-07 16:55:25,720 INFO [RS:0;jenkins-hbase12:33237] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-07 16:55:25,735 INFO [RS:0;jenkins-hbase12:33237] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-07 16:55:25,737 INFO [RS:0;jenkins-hbase12:33237] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:55:25,738 INFO [RS:0;jenkins-hbase12:33237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,739 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-07 16:55:25,744 INFO [RS:0;jenkins-hbase12:33237] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,744 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,745 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,745 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,745 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,746 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,746 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase12:0, corePoolSize=2, maxPoolSize=2 2023-02-07 16:55:25,746 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,746 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,746 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,746 DEBUG [RS:0;jenkins-hbase12:33237] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-07 16:55:25,747 INFO [RS:0;jenkins-hbase12:33237] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,747 INFO [RS:0;jenkins-hbase12:33237] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,747 INFO [RS:0;jenkins-hbase12:33237] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,761 INFO [RS:0;jenkins-hbase12:33237] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-07 16:55:25,763 INFO [RS:0;jenkins-hbase12:33237] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,33237,1675788923983-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:25,776 INFO [RS:0;jenkins-hbase12:33237] regionserver.Replication(203): jenkins-hbase12.apache.org,33237,1675788923983 started 2023-02-07 16:55:25,776 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1638): Serving as jenkins-hbase12.apache.org,33237,1675788923983, RpcServer on jenkins-hbase12.apache.org/136.243.104.168:33237, sessionid=0x1013e59781e0001 2023-02-07 16:55:25,777 DEBUG [RS:0;jenkins-hbase12:33237] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-07 16:55:25,777 DEBUG [RS:0;jenkins-hbase12:33237] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:25,777 DEBUG [RS:0;jenkins-hbase12:33237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase12.apache.org,33237,1675788923983' 2023-02-07 16:55:25,777 DEBUG [RS:0;jenkins-hbase12:33237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:25,778 DEBUG [RS:0;jenkins-hbase12:33237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:25,778 DEBUG [RS:0;jenkins-hbase12:33237] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-07 16:55:25,778 DEBUG [RS:0;jenkins-hbase12:33237] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-07 16:55:25,778 DEBUG [RS:0;jenkins-hbase12:33237] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:25,778 DEBUG [RS:0;jenkins-hbase12:33237] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase12.apache.org,33237,1675788923983' 2023-02-07 16:55:25,778 DEBUG [RS:0;jenkins-hbase12:33237] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 16:55:25,779 DEBUG [RS:0;jenkins-hbase12:33237] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 16:55:25,779 DEBUG [RS:0;jenkins-hbase12:33237] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-07 16:55:25,780 INFO [RS:0;jenkins-hbase12:33237] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-07 16:55:25,780 INFO [RS:0;jenkins-hbase12:33237] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-07 16:55:25,897 INFO [RS:0;jenkins-hbase12:33237] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C33237%2C1675788923983, suffix=, logDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/WALs/jenkins-hbase12.apache.org,33237,1675788923983, archiveDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/oldWALs, maxLogs=32 2023-02-07 16:55:25,912 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33799,DS-087f676e-2dc6-4b9b-a952-e6a9ab68adfb,DISK] 2023-02-07 16:55:25,915 INFO [RS:0;jenkins-hbase12:33237] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/WALs/jenkins-hbase12.apache.org,33237,1675788923983/jenkins-hbase12.apache.org%2C33237%2C1675788923983.1675788925899 2023-02-07 16:55:25,915 DEBUG [RS:0;jenkins-hbase12:33237] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33799,DS-087f676e-2dc6-4b9b-a952-e6a9ab68adfb,DISK]] 2023-02-07 16:55:25,993 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:25,998 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 16:55:26,004 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/info 2023-02-07 16:55:26,005 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 16:55:26,006 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:26,007 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 16:55:26,010 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/rep_barrier 2023-02-07 16:55:26,010 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 16:55:26,011 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:26,011 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 16:55:26,014 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/table 2023-02-07 16:55:26,014 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 16:55:26,015 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:26,017 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740 2023-02-07 16:55:26,018 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740 2023-02-07 16:55:26,021 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 16:55:26,023 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 16:55:26,027 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:55:26,028 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59657048, jitterRate=-0.11104071140289307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 16:55:26,028 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675788925993Initializing all the Stores at 1675788925996 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675788925997 (+1 ms)Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675788925997Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675788925997Cleaning up temporary data from old regions at 1675788926020 (+23 ms)Cleaning up detritus from prior splits at 1675788926020Region opened successfully at 1675788926028 (+8 ms) 2023-02-07 16:55:26,028 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 16:55:26,029 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 16:55:26,029 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 16:55:26,029 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 16:55:26,029 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 16:55:26,030 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 16:55:26,030 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675788926028Disabling compacts and flushes for region at 1675788926028Disabling writes for close at 1675788926029 (+1 ms)Writing region close event to WAL at 1675788926030 (+1 ms)Closed at 1675788926030 2023-02-07 16:55:26,036 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-07 16:55:26,036 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-07 16:55:26,044 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-07 16:55:26,054 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-07 16:55:26,056 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-07 16:55:26,211 DEBUG [jenkins-hbase12:45371] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-07 16:55:26,217 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase12.apache.org,33237,1675788923983, state=OPENING 2023-02-07 16:55:26,270 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-07 16:55:26,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:55:26,282 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 16:55:26,285 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:55:26,474 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:26,476 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 16:55:26,479 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:59722, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 16:55:26,490 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-07 16:55:26,491 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-07 16:55:26,495 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C33237%2C1675788923983.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/WALs/jenkins-hbase12.apache.org,33237,1675788923983, archiveDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/oldWALs, maxLogs=32 2023-02-07 16:55:26,510 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33799,DS-087f676e-2dc6-4b9b-a952-e6a9ab68adfb,DISK] 2023-02-07 16:55:26,514 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/WALs/jenkins-hbase12.apache.org,33237,1675788923983/jenkins-hbase12.apache.org%2C33237%2C1675788923983.meta.1675788926496.meta 2023-02-07 16:55:26,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33799,DS-087f676e-2dc6-4b9b-a952-e6a9ab68adfb,DISK]] 2023-02-07 16:55:26,515 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:55:26,516 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-07 16:55:26,530 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-07 16:55:26,534 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-07 16:55:26,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-07 16:55:26,538 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:26,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-07 16:55:26,539 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-07 16:55:26,541 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-07 16:55:26,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/info 2023-02-07 16:55:26,543 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/info 2023-02-07 16:55:26,544 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-07 16:55:26,544 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:26,544 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-07 16:55:26,546 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/rep_barrier 2023-02-07 16:55:26,546 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/rep_barrier 2023-02-07 16:55:26,546 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-07 16:55:26,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:26,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-07 16:55:26,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/table 2023-02-07 16:55:26,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/table 2023-02-07 16:55:26,549 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-07 16:55:26,550 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:26,552 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740 2023-02-07 16:55:26,555 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740 2023-02-07 16:55:26,559 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-07 16:55:26,562 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-07 16:55:26,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60050324, jitterRate=-0.10518044233322144}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-07 16:55:26,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675788926539Writing region info on filesystem at 1675788926539Initializing all the Stores at 1675788926541 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675788926541Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675788926541Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675788926541Cleaning up temporary data from old regions at 1675788926557 (+16 ms)Cleaning up detritus from prior splits at 1675788926558 (+1 ms)Running coprocessor post-open hooks at 1675788926563 (+5 ms)Region opened successfully at 1675788926564 (+1 ms) 2023-02-07 16:55:26,571 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675788926467 2023-02-07 16:55:26,585 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-07 16:55:26,586 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-07 16:55:26,587 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase12.apache.org,33237,1675788923983, state=OPEN 2023-02-07 16:55:26,660 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-07 16:55:26,660 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-07 16:55:26,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-07 16:55:26,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase12.apache.org,33237,1675788923983 in 375 msec 2023-02-07 16:55:26,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-07 16:55:26,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 626 msec 2023-02-07 16:55:26,681 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2040 sec 2023-02-07 16:55:26,681 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675788924057, completionTime=-1 2023-02-07 16:55:26,681 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-07 16:55:26,682 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-07 16:55:26,735 DEBUG [hconnection-0x34101d50-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:55:26,739 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:59730, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:55:26,754 INFO [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-07 16:55:26,755 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675788986755 2023-02-07 16:55:26,755 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675789046755 2023-02-07 16:55:26,755 INFO [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 72 msec 2023-02-07 16:55:26,799 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,45371,1675788922805-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:26,800 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,45371,1675788922805-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:26,800 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,45371,1675788922805-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:26,802 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase12:45371, period=300000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:26,802 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-07 16:55:26,810 DEBUG [master/jenkins-hbase12:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-07 16:55:26,818 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-07 16:55:26,819 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-07 16:55:26,827 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-07 16:55:26,829 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:55:26,832 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:55:26,852 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:26,855 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88 empty. 2023-02-07 16:55:26,856 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:26,856 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-07 16:55:27,282 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-07 16:55:27,285 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => 80ab7ed2650e941e369ed7c24a6b4c88, NAME => 'hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:55:27,697 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:27,698 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing 80ab7ed2650e941e369ed7c24a6b4c88, disabling compactions & flushes 2023-02-07 16:55:27,698 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:55:27,698 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:55:27,698 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. after waiting 0 ms 2023-02-07 16:55:27,698 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:55:27,698 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:55:27,698 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for 80ab7ed2650e941e369ed7c24a6b4c88: Waiting for close lock at 1675788927698Disabling compacts and flushes for region at 1675788927698Disabling writes for close at 1675788927698Writing region close event to WAL at 1675788927698Closed at 1675788927698 2023-02-07 16:55:27,707 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:55:27,719 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675788927709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788927709"}]},"ts":"1675788927709"} 2023-02-07 16:55:27,741 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:55:27,742 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:55:27,747 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788927743"}]},"ts":"1675788927743"} 2023-02-07 16:55:27,752 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-07 16:55:27,875 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=80ab7ed2650e941e369ed7c24a6b4c88, ASSIGN}] 2023-02-07 16:55:27,881 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=80ab7ed2650e941e369ed7c24a6b4c88, ASSIGN 2023-02-07 16:55:27,884 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=80ab7ed2650e941e369ed7c24a6b4c88, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:55:28,036 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=80ab7ed2650e941e369ed7c24a6b4c88, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:28,037 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675788928036"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788928036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788928036"}]},"ts":"1675788928036"} 2023-02-07 16:55:28,044 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 80ab7ed2650e941e369ed7c24a6b4c88, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:55:28,207 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:55:28,208 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 80ab7ed2650e941e369ed7c24a6b4c88, NAME => 'hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:55:28,209 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:28,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:28,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:28,210 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:28,212 INFO [StoreOpener-80ab7ed2650e941e369ed7c24a6b4c88-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:28,215 DEBUG [StoreOpener-80ab7ed2650e941e369ed7c24a6b4c88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88/info 2023-02-07 16:55:28,215 DEBUG [StoreOpener-80ab7ed2650e941e369ed7c24a6b4c88-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88/info 2023-02-07 16:55:28,216 INFO [StoreOpener-80ab7ed2650e941e369ed7c24a6b4c88-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80ab7ed2650e941e369ed7c24a6b4c88 columnFamilyName info 2023-02-07 16:55:28,217 INFO [StoreOpener-80ab7ed2650e941e369ed7c24a6b4c88-1] regionserver.HStore(310): Store=80ab7ed2650e941e369ed7c24a6b4c88/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:28,219 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:28,220 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:28,224 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:55:28,228 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:55:28,229 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 80ab7ed2650e941e369ed7c24a6b4c88; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65604961, jitterRate=-0.022409901022911072}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:55:28,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 80ab7ed2650e941e369ed7c24a6b4c88: Running coprocessor pre-open hook at 1675788928210Writing region info on filesystem at 1675788928210Initializing all the Stores at 1675788928212 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675788928212Cleaning up temporary data from old regions at 1675788928221 (+9 ms)Cleaning up detritus from prior splits at 1675788928221Running coprocessor post-open hooks at 1675788928229 (+8 ms)Region opened successfully at 1675788928229 2023-02-07 16:55:28,231 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88., pid=6, masterSystemTime=1675788928198 2023-02-07 16:55:28,234 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:55:28,234 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:55:28,235 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=80ab7ed2650e941e369ed7c24a6b4c88, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:28,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675788928235"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788928235"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788928235"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788928235"}]},"ts":"1675788928235"} 2023-02-07 16:55:28,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-07 16:55:28,243 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 80ab7ed2650e941e369ed7c24a6b4c88, server=jenkins-hbase12.apache.org,33237,1675788923983 in 196 msec 2023-02-07 16:55:28,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-07 16:55:28,247 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=80ab7ed2650e941e369ed7c24a6b4c88, ASSIGN in 368 msec 2023-02-07 16:55:28,248 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:55:28,248 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788928248"}]},"ts":"1675788928248"} 2023-02-07 16:55:28,251 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-07 16:55:28,305 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:55:28,309 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.4850 sec 2023-02-07 16:55:28,331 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-07 16:55:28,344 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-07 16:55:28,344 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:55:28,390 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-07 16:55:28,478 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 16:55:28,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 133 msec 2023-02-07 16:55:28,525 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-07 16:55:28,544 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 16:55:28,560 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 34 msec 2023-02-07 16:55:28,592 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-07 16:55:28,613 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-07 16:55:28,613 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 4.525sec 2023-02-07 16:55:28,618 INFO [master/jenkins-hbase12:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-07 16:55:28,621 INFO [master/jenkins-hbase12:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-07 16:55:28,622 INFO [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-07 16:55:28,622 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,45371,1675788922805-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-07 16:55:28,624 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,45371,1675788922805-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-07 16:55:28,629 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ReadOnlyZKClient(139): Connect 0x2c0738cf to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:55:28,635 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-07 16:55:28,645 DEBUG [Listener at localhost.localdomain/41849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f2ea739, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:55:28,660 DEBUG [hconnection-0x180ae66a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:55:28,671 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:59740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:55:28,679 INFO [Listener at localhost.localdomain/41849] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:55:28,680 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ReadOnlyZKClient(139): Connect 0x6b8bb120 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:55:28,692 DEBUG [Listener at localhost.localdomain/41849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@649a9174, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:55:28,692 INFO [Listener at localhost.localdomain/41849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:55:28,711 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=210, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=171, AvailableMemoryMB=3121 2023-02-07 16:55:28,714 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:28,714 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:28,722 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:55:28,725 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:34186, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:55:28,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-07 16:55:28,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:28,742 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:55:28,744 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:55:28,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-07 16:55:28,747 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:28,749 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108 empty. 2023-02-07 16:55:28,750 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:28,750 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-07 16:55:28,754 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:28,754 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:28,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-07 16:55:28,861 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:28,861 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:28,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-07 16:55:29,068 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:29,068 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:29,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-07 16:55:29,171 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-07 16:55:29,173 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 26096b9ae816592d3ba6c249c461d108, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:55:29,374 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:29,375 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:29,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-07 16:55:29,589 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:29,590 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 26096b9ae816592d3ba6c249c461d108, disabling compactions & flushes 2023-02-07 16:55:29,590 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:29,590 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:29,591 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. after waiting 0 ms 2023-02-07 16:55:29,591 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:29,592 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:29,592 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 26096b9ae816592d3ba6c249c461d108: Waiting for close lock at 1675788929590Disabling compacts and flushes for region at 1675788929590Disabling writes for close at 1675788929591 (+1 ms)Writing region close event to WAL at 1675788929592 (+1 ms)Closed at 1675788929592 2023-02-07 16:55:29,597 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:55:29,599 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675788929599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788929599"}]},"ts":"1675788929599"} 2023-02-07 16:55:29,602 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:55:29,603 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:55:29,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788929603"}]},"ts":"1675788929603"} 2023-02-07 16:55:29,606 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-07 16:55:29,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=26096b9ae816592d3ba6c249c461d108, ASSIGN}] 2023-02-07 16:55:29,729 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=26096b9ae816592d3ba6c249c461d108, ASSIGN 2023-02-07 16:55:29,734 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=26096b9ae816592d3ba6c249c461d108, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:55:29,881 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:29,882 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:29,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-07 16:55:29,885 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=26096b9ae816592d3ba6c249c461d108, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:29,886 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675788929885"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788929885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788929885"}]},"ts":"1675788929885"} 2023-02-07 16:55:29,889 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 26096b9ae816592d3ba6c249c461d108, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:55:30,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:30,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 26096b9ae816592d3ba6c249c461d108, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:55:30,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:30,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:30,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:30,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:30,061 INFO [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:30,064 DEBUG [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:30,064 DEBUG [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:30,067 INFO [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26096b9ae816592d3ba6c249c461d108 columnFamilyName family1 2023-02-07 16:55:30,071 INFO [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] regionserver.HStore(310): Store=26096b9ae816592d3ba6c249c461d108/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:30,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:30,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:30,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:30,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:55:30,083 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 26096b9ae816592d3ba6c249c461d108; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66006232, jitterRate=-0.01643049716949463}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:55:30,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 26096b9ae816592d3ba6c249c461d108: Running coprocessor pre-open hook at 1675788930057Writing region info on filesystem at 1675788930057Initializing all the Stores at 1675788930059 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675788930059Cleaning up temporary data from old regions at 1675788930075 (+16 ms)Cleaning up detritus from prior splits at 1675788930075Running coprocessor post-open hooks at 1675788930083 (+8 ms)Region opened successfully at 1675788930083 2023-02-07 16:55:30,084 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108., pid=11, masterSystemTime=1675788930043 2023-02-07 16:55:30,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:30,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:30,088 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=26096b9ae816592d3ba6c249c461d108, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:30,089 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675788930088"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788930088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788930088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788930088"}]},"ts":"1675788930088"} 2023-02-07 16:55:30,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-07 16:55:30,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 26096b9ae816592d3ba6c249c461d108, server=jenkins-hbase12.apache.org,33237,1675788923983 in 203 msec 2023-02-07 16:55:30,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-07 16:55:30,098 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=26096b9ae816592d3ba6c249c461d108, ASSIGN in 370 msec 2023-02-07 16:55:30,099 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:55:30,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788930099"}]},"ts":"1675788930099"} 2023-02-07 16:55:30,101 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-07 16:55:30,168 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:55:30,172 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4300 sec 2023-02-07 16:55:30,884 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:30,884 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:30,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-07 16:55:30,888 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-07 16:55:30,909 DEBUG [hconnection-0x725cc12b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:55:30,913 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:59756, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:55:31,046 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:31,046 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:31,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:31,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:31,059 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:31,059 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:31,059 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:31,059 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:31,060 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:31,060 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:31,123 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:31,123 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:31,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:31,124 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:31,124 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:31,125 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:31,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:31,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:31,126 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:31,128 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:31,128 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:31,129 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:31,129 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:31,130 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:31,130 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:31,130 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:31,131 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:31,132 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-07 16:55:31,703 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130749ee4091c174c05aeea8dc02e0c40f3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130749ee4091c174c05aeea8dc02e0c40f3 2023-02-07 16:55:32,068 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:55:32,121 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-07 16:55:32,122 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/3ce0ffd43d0a45d08bb88299cb3ecd97 2023-02-07 16:55:32,124 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-07 16:55:32,125 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:32,131 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/3ce0ffd43d0a45d08bb88299cb3ecd97 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/3ce0ffd43d0a45d08bb88299cb3ecd97 2023-02-07 16:55:32,141 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/3ce0ffd43d0a45d08bb88299cb3ecd97, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-07 16:55:32,143 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 1011ms, sequenceid=5, compaction requested=false 2023-02-07 16:55:32,144 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:32,144 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:32,144 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:32,145 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:32,145 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,145 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:32,145 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:32,207 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,207 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:32,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:32,208 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,209 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:32,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:32,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:32,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:32,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:32,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@146c9bf4[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:32,215 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:32,215 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,228 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,229 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:32,229 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:32,230 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,230 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:32,230 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:32,245 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:32,245 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,245 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,246 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:32,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:32,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:32,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:32,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:32,251 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:32,251 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:32,251 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:32,251 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,251 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:32,260 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,260 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,260 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:32,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:32,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:32,261 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:32,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,263 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:32,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:32,281 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:32,281 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:32,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:32,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:32,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:32,283 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:32,283 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:32,384 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:32,385 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:32,385 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:32,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:32,406 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:32,406 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:32,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:32,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:32,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,412 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:32,412 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:32,413 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:32,413 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:32,414 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,414 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:32,423 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:32,423 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:32,423 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:32,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:32,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,424 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,425 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:32,425 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:32,425 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:32,425 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:32,425 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:32,426 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:32,426 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:32,426 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:32,426 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:32,426 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-07 16:55:32,886 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281cb352e835964dfb959b3eeb4a7c525e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511281cb352e835964dfb959b3eeb4a7c525e 2023-02-07 16:55:32,978 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 16:55:32,978 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-07 16:55:33,304 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/a58458207c0746b8984b9a4b188ed47d 2023-02-07 16:55:33,318 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/a58458207c0746b8984b9a4b188ed47d as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a58458207c0746b8984b9a4b188ed47d 2023-02-07 16:55:33,324 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a58458207c0746b8984b9a4b188ed47d, entries=1, sequenceid=9, filesize=5.0 K 2023-02-07 16:55:33,326 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 900ms, sequenceid=9, compaction requested=false 2023-02-07 16:55:33,326 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:33,326 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:33,326 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:33,327 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:33,327 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,327 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:33,327 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:33,375 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,375 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:33,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:33,377 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,377 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:33,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:33,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:33,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:33,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:33,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59f4a772[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:33,383 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:33,383 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,397 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:33,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:33,398 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:33,398 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,398 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:33,477 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:33,477 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:33,477 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,477 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:33,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:33,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:33,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:33,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:33,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:33,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:33,489 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:33,489 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:33,489 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:33,489 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:33,489 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,490 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:33,562 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,562 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:33,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,563 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:33,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:33,565 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,565 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:33,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:33,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,570 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:33,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,617 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,618 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:33,618 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:33,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:33,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-07 16:55:33,618 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:33,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:33,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:33,618 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:33,618 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,620 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,620 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,620 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:33,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:33,620 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,620 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,620 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:33,620 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:33,721 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:33,721 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:33,721 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:33,736 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:33,736 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:33,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:33,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:33,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,742 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:33,742 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:33,743 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:33,743 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:33,743 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,744 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,754 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:33,754 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:33,755 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:33,755 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:33,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,755 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:33,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,756 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,756 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:33,756 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:33,756 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:33,756 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:33,757 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:33,757 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:33,757 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:33,757 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:33,757 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:33,757 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:34,193 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013ed4a17d7af6434f83fb5bf5a1b28c6f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512013ed4a17d7af6434f83fb5bf5a1b28c6f 2023-02-07 16:55:34,606 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/ddcecc0f89a54cbbbd6b3cd631a5e806 2023-02-07 16:55:34,620 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/ddcecc0f89a54cbbbd6b3cd631a5e806 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ddcecc0f89a54cbbbd6b3cd631a5e806 2023-02-07 16:55:34,628 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ddcecc0f89a54cbbbd6b3cd631a5e806, entries=1, sequenceid=13, filesize=5.0 K 2023-02-07 16:55:34,629 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 872ms, sequenceid=13, compaction requested=true 2023-02-07 16:55:34,629 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:34,629 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:34,629 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:34,630 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:34,630 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,630 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:34,630 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:34,702 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,702 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:34,703 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,703 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:34,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:34,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:34,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fcd8c98[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:34,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:34,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,717 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,718 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:34,718 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:34,718 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:34,718 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,718 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:34,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:34,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:34,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:34,728 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:34,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:34,733 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:34,733 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:34,733 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:34,733 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,733 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:34,743 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,743 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:34,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,744 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:34,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:34,745 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:34,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,747 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,760 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,760 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:34,760 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:34,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:34,760 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-07 16:55:34,760 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,760 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:34,760 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:34,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:34,760 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:34,760 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:34,760 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:34,761 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,761 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,761 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:34,761 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:34,861 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:34,862 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:34,862 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:34,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:34,876 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:34,876 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:34,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:34,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:34,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,880 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:34,880 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:34,880 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:34,880 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:34,881 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,881 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,891 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:34,891 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:34,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:34,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:34,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,893 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,894 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:34,894 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:34,894 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:34,894 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:34,894 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:34,895 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:34,895 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:34,895 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:34,895 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:34,895 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:35,332 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c5a644ae2f2c4669a1f2c4a5ddbdbc52 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c5a644ae2f2c4669a1f2c4a5ddbdbc52 2023-02-07 16:55:35,746 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/da77acffc0634bf798acc3c1b0fd4ad8 2023-02-07 16:55:35,760 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/da77acffc0634bf798acc3c1b0fd4ad8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/da77acffc0634bf798acc3c1b0fd4ad8 2023-02-07 16:55:35,768 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/da77acffc0634bf798acc3c1b0fd4ad8, entries=1, sequenceid=17, filesize=5.0 K 2023-02-07 16:55:35,769 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 874ms, sequenceid=17, compaction requested=true 2023-02-07 16:55:35,769 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:35,769 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:35,769 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:35,770 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:35,770 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,770 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:35,770 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:35,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,817 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:35,819 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:35,819 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:35,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:35,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34d2e58c[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:35,824 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:35,824 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,833 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,834 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:35,834 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:35,834 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:35,835 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,835 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:35,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:35,850 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:35,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:35,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:35,851 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:35,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:35,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:35,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:35,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:35,864 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:35,864 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:35,864 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:35,864 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:35,864 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,864 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:35,875 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,875 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:35,875 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:35,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:35,876 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:35,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,879 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,891 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:35,891 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:35,891 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:35,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:35,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:35,891 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:35,891 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-07 16:55:35,892 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,892 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:35,892 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:35,892 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:35,892 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:35,892 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:35,892 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:35,992 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:35,993 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:35,993 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:35,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:36,006 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:36,006 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:36,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:36,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:36,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,010 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:36,010 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:36,010 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:36,010 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:36,011 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,011 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,023 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:36,023 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:36,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:36,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:36,023 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:36,023 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:36,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:36,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,025 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,026 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:36,026 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,026 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:36,026 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:36,026 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:36,027 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:36,027 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:36,027 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:36,027 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:36,027 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:36,453 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280f0b06c12fe94eb68e8f993561780d9d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280f0b06c12fe94eb68e8f993561780d9d 2023-02-07 16:55:36,865 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/a244d2eed20a417c9dd23a251dce736b 2023-02-07 16:55:36,881 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/a244d2eed20a417c9dd23a251dce736b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a244d2eed20a417c9dd23a251dce736b 2023-02-07 16:55:36,890 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a244d2eed20a417c9dd23a251dce736b, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 16:55:36,891 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 864ms, sequenceid=21, compaction requested=true 2023-02-07 16:55:36,892 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:36,892 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:36,892 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:36,892 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:36,892 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:36,892 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:36,892 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:36,989 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:36,989 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:36,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:36,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:36,990 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,990 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:36,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:36,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:36,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:36,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:36,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:36,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:36,996 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44916bd9[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:36,996 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:36,997 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,017 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,018 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:37,018 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:37,018 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:37,018 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,018 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:37,028 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:37,028 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,028 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:37,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:37,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:37,028 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:37,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:37,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:37,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:37,042 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:37,042 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:37,042 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:37,042 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,042 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:37,054 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,054 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:37,054 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:37,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:37,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:37,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:37,056 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:37,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,059 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:37,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,070 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,070 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:37,070 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,070 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:37,070 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-07 16:55:37,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:37,070 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:37,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:37,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:37,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:37,071 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,072 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,072 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,072 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,072 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:37,072 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:37,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:37,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:37,172 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:37,173 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:37,173 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:37,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:37,180 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:37,180 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:37,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:37,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:37,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,184 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:37,184 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:37,184 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:37,184 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:37,185 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,185 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,196 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:37,196 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:37,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:37,196 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,197 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:37,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,197 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:37,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,198 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,198 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:37,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,198 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:37,198 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:37,199 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:37,199 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:37,199 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:37,199 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:37,199 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:37,200 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:37,632 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231efa452637bc84844931760f77af775c1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231efa452637bc84844931760f77af775c1 2023-02-07 16:55:37,643 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/a545d26ead6d481cb9370e12810f840b 2023-02-07 16:55:37,652 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/a545d26ead6d481cb9370e12810f840b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a545d26ead6d481cb9370e12810f840b 2023-02-07 16:55:37,660 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a545d26ead6d481cb9370e12810f840b, entries=1, sequenceid=25, filesize=5.0 K 2023-02-07 16:55:37,661 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 461ms, sequenceid=25, compaction requested=true 2023-02-07 16:55:37,661 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:37,661 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:37,661 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:37,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:37,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:37,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:37,712 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,712 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:37,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:37,713 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,713 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:37,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:37,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:37,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:37,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:37,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38a28b0e[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:37,715 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:37,715 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,728 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:37,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:37,728 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,728 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:37,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:37,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:37,738 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:37,739 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:37,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:37,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:37,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:37,741 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:37,741 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:37,741 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:37,741 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,741 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:37,754 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,754 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:37,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,754 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:37,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:37,755 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:37,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,757 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:37,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,770 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,770 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:37,770 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:37,770 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:37,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:37,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:37,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:37,770 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:37,770 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,771 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,771 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,771 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,771 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:37,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:37,772 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:37,772 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:37,872 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:37,872 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:37,872 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:37,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:37,888 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:37,888 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:37,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:37,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:37,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,891 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:37,891 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:37,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:37,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:37,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,901 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:37,901 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:37,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:37,902 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:37,902 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:37,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:37,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,904 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,904 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:37,905 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:37,905 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:37,905 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:37,905 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:37,906 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:37,906 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:37,906 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:37,906 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:37,906 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:38,333 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010107d5978750bb44189d8665e493710348 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010107d5978750bb44189d8665e493710348 2023-02-07 16:55:38,343 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/48fbbbabb09f47689ff47146c7e39c3b 2023-02-07 16:55:38,350 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/48fbbbabb09f47689ff47146c7e39c3b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/48fbbbabb09f47689ff47146c7e39c3b 2023-02-07 16:55:38,358 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/48fbbbabb09f47689ff47146c7e39c3b, entries=1, sequenceid=29, filesize=5.0 K 2023-02-07 16:55:38,359 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 453ms, sequenceid=29, compaction requested=true 2023-02-07 16:55:38,359 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:38,359 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:38,359 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:38,360 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:38,360 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,360 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:38,360 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:38,407 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,407 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:38,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:38,408 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,408 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:38,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:38,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:38,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:38,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b6869ce[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:38,414 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:38,414 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,422 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:38,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:38,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:38,423 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,423 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:38,433 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:38,433 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,433 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:38,433 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:38,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:38,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:38,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:38,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:38,437 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:38,437 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:38,438 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:38,438 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,438 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:38,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:38,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:38,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:38,450 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:38,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:38,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,452 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:38,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,487 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,487 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:38,487 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:38,488 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:38,488 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:38,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:38,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:38,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:38,488 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-07 16:55:38,489 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,490 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,490 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:38,490 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:38,490 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:38,491 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,590 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:38,591 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:38,591 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:38,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:38,605 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:38,605 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:38,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:38,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:38,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,608 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:38,608 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:38,609 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:38,609 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:38,609 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,609 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,627 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:38,627 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:38,628 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:38,628 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,629 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,629 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:38,629 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:38,629 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:38,629 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:38,630 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:38,630 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:38,630 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:38,630 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:38,630 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:38,630 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:38,655 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036db967b15b3442cbb09d60db152ca4cf to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036db967b15b3442cbb09d60db152ca4cf 2023-02-07 16:55:39,066 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/5b78f08e04e14cc498be9ba20e39f3f0 2023-02-07 16:55:39,082 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/5b78f08e04e14cc498be9ba20e39f3f0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/5b78f08e04e14cc498be9ba20e39f3f0 2023-02-07 16:55:39,091 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/5b78f08e04e14cc498be9ba20e39f3f0, entries=1, sequenceid=33, filesize=5.0 K 2023-02-07 16:55:39,093 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 463ms, sequenceid=33, compaction requested=true 2023-02-07 16:55:39,093 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:39,093 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:39,093 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:39,093 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:39,093 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,094 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:39,094 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:39,143 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,143 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:39,145 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,145 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:39,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:39,149 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@783519aa[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:39,149 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:39,150 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,160 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:39,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:39,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:39,161 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,161 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:39,175 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:39,175 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:39,175 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:39,175 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:39,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:39,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:39,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:39,188 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:39,189 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:39,189 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:39,189 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,189 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:39,201 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,202 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,202 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:39,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:39,202 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:39,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:39,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,203 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:39,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,288 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,288 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:39,288 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,289 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:39,288 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:39,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:39,288 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:39,289 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-07 16:55:39,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:39,291 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:39,289 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,291 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,292 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:39,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:39,292 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:39,292 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,293 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:39,293 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,393 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:39,393 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:39,393 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:39,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:39,405 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:39,406 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:39,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:39,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:39,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,410 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:39,410 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:39,411 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:39,411 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:39,412 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,412 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,444 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:39,444 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:39,445 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:39,445 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:39,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,448 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,448 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:39,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:39,450 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:39,450 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:39,451 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:39,451 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:39,451 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:39,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:39,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:39,452 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:39,884 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907803dfb69fdab49bcab233a2a6ca6edb5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907803dfb69fdab49bcab233a2a6ca6edb5 2023-02-07 16:55:40,296 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/ea73850427564262a0f6d8ebd83b0240 2023-02-07 16:55:40,309 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/ea73850427564262a0f6d8ebd83b0240 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ea73850427564262a0f6d8ebd83b0240 2023-02-07 16:55:40,319 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ea73850427564262a0f6d8ebd83b0240, entries=1, sequenceid=37, filesize=5.0 K 2023-02-07 16:55:40,320 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 868ms, sequenceid=37, compaction requested=true 2023-02-07 16:55:40,320 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:40,320 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:40,320 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:40,321 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:40,321 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,321 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:40,321 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:40,396 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,396 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:40,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:40,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:40,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:40,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:40,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:40,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:40,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@37b56ad6[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:40,403 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:40,404 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,412 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,412 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:40,412 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:40,412 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:40,413 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,413 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:40,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:40,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:40,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:40,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:40,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:40,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:40,426 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:40,426 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:40,426 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:40,426 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,426 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:40,438 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,438 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:40,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,438 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:40,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:40,439 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:40,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,440 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:40,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:40,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:40,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:40,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:40,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:40,448 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:40,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,449 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:40,450 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:40,450 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:40,450 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:40,450 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,450 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,550 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:40,550 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:40,551 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:40,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:40,564 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:40,564 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:40,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:40,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:40,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,568 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:40,568 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:40,569 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-07 16:55:40,569 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-07 16:55:40,569 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,569 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,580 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:40,580 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:40,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:40,581 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:40,581 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:40,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,581 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:40,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,582 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,582 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-07 16:55:40,582 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:40,583 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-07 16:55:40,583 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:40,584 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-07 16:55:40,584 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:40,584 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:40,584 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:40,584 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. started... 2023-02-07 16:55:40,585 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 26096b9ae816592d3ba6c249c461d108 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:41,013 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120823f3c78b550446a915d53ffc8693ae1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120823f3c78b550446a915d53ffc8693ae1 2023-02-07 16:55:41,422 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/2e3d1ff83eeb47c689c224158edc63ea 2023-02-07 16:55:41,437 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/2e3d1ff83eeb47c689c224158edc63ea as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/2e3d1ff83eeb47c689c224158edc63ea 2023-02-07 16:55:41,445 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/2e3d1ff83eeb47c689c224158edc63ea, entries=1, sequenceid=41, filesize=5.0 K 2023-02-07 16:55:41,446 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 26096b9ae816592d3ba6c249c461d108 in 861ms, sequenceid=41, compaction requested=true 2023-02-07 16:55:41,446 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:41,446 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:41,446 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:41,446 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:41,446 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,446 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-07 16:55:41,446 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-07 16:55:41,512 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,512 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:41,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:41,513 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,513 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:41,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:41,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:41,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-07 16:55:41,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b637dd5[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:41,517 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-07 16:55:41,517 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,554 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,554 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-07 16:55:41,554 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-07 16:55:41,554 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:41,555 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,555 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:41,575 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-07 16:55:41,575 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,575 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:41,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:41,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:41,576 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-07 16:55:41,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:41,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:41,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:41,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:41,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-07 16:55:41,586 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-07 16:55:41,586 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:41,586 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:41,586 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,586 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:41,596 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,596 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,596 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:41,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:41,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:41,596 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,597 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:41,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:41,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:41,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-07 16:55:41,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:41,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:41,607 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:41,607 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-07 16:55:41,606 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:41,607 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:41,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:41,607 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:41,607 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:41,607 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,608 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,708 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:41,708 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:41,708 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:41,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:41,724 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 16:55:41,727 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:44740, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 16:55:41,728 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:41,739 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-07 16:55:41,740 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-07 16:55:41,741 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:55:41,741 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789541741 2023-02-07 16:55:41,744 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:55:41,747 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-07 16:55:41,747 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:41,748 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x03e0c654 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:55:41,760 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@53bfcc31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:55:41,762 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,677 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010310d16b91e46d40d3b79eba448568b75f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010310d16b91e46d40d3b79eba448568b75f 2023-02-07 16:55:42,678 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:42,694 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:55:42,695 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:37068, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:55:42,705 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:42,705 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:42,706 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:55:42,708 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:44742, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:55:42,742 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2cb38178593d4bdfb28ff9132110c72b first=Optional[r3] last=Optional[r6] 2023-02-07 16:55:42,753 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2cb38178593d4bdfb28ff9132110c72b}] 2023-02-07 16:55:42,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2cb38178593d4bdfb28ff9132110c72b for inclusion in 26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:42,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-07 16:55:42,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:55:42,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:42,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2cb38178593d4bdfb28ff9132110c72b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fpvrdqd53jif7kj7o20sccugb4e4d3d5oaidb5gen3bribd2qqdame1d1mc26qfb/family1/2cb38178593d4bdfb28ff9132110c72b 2023-02-07 16:55:42,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fpvrdqd53jif7kj7o20sccugb4e4d3d5oaidb5gen3bribd2qqdame1d1mc26qfb/family1/2cb38178593d4bdfb28ff9132110c72b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/76326ac5d21444afbf45d0f77a239e27_SeqId_44_ 2023-02-07 16:55:42,781 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fpvrdqd53jif7kj7o20sccugb4e4d3d5oaidb5gen3bribd2qqdame1d1mc26qfb/family1/2cb38178593d4bdfb28ff9132110c72b into 26096b9ae816592d3ba6c249c461d108/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/76326ac5d21444afbf45d0f77a239e27_SeqId_44_ - updating store file list. 2023-02-07 16:55:42,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/76326ac5d21444afbf45d0f77a239e27_SeqId_44_ into 26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:42,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fpvrdqd53jif7kj7o20sccugb4e4d3d5oaidb5gen3bribd2qqdame1d1mc26qfb/family1/2cb38178593d4bdfb28ff9132110c72b into 26096b9ae816592d3ba6c249c461d108/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/76326ac5d21444afbf45d0f77a239e27_SeqId_44_) 2023-02-07 16:55:42,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__fpvrdqd53jif7kj7o20sccugb4e4d3d5oaidb5gen3bribd2qqdame1d1mc26qfb/family1/2cb38178593d4bdfb28ff9132110c72b 2023-02-07 16:55:42,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-07 16:55:42,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-07 16:55:42,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): 26096b9ae816592d3ba6c249c461d108/family1 is initiating minor compaction 2023-02-07 16:55:42,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@37ff0ca6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:55:42,800 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 26096b9ae816592d3ba6c249c461d108/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:42,800 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a58458207c0746b8984b9a4b188ed47d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ddcecc0f89a54cbbbd6b3cd631a5e806, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/da77acffc0634bf798acc3c1b0fd4ad8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a244d2eed20a417c9dd23a251dce736b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a545d26ead6d481cb9370e12810f840b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/48fbbbabb09f47689ff47146c7e39c3b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/5b78f08e04e14cc498be9ba20e39f3f0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ea73850427564262a0f6d8ebd83b0240, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/2e3d1ff83eeb47c689c224158edc63ea, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/76326ac5d21444afbf45d0f77a239e27_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp, totalSize=50.2 K 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting a58458207c0746b8984b9a4b188ed47d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting ddcecc0f89a54cbbbd6b3cd631a5e806, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting da77acffc0634bf798acc3c1b0fd4ad8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting a244d2eed20a417c9dd23a251dce736b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting a545d26ead6d481cb9370e12810f840b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 48fbbbabb09f47689ff47146c7e39c3b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 5b78f08e04e14cc498be9ba20e39f3f0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting ea73850427564262a0f6d8ebd83b0240, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 2e3d1ff83eeb47c689c224158edc63ea, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-07 16:55:42,801 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 76326ac5d21444afbf45d0f77a239e27_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-07 16:55:42,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:42,818 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:55:42,824 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280f0b06c12fe94eb68e8f993561780d9d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512280f0b06c12fe94eb68e8f993561780d9d 2023-02-07 16:55:42,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231efa452637bc84844931760f77af775c1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231efa452637bc84844931760f77af775c1 2023-02-07 16:55:42,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010107d5978750bb44189d8665e493710348 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010107d5978750bb44189d8665e493710348 2023-02-07 16:55:42,830 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036db967b15b3442cbb09d60db152ca4cf to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601036db967b15b3442cbb09d60db152ca4cf 2023-02-07 16:55:42,830 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-07 16:55:42,830 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-07 16:55:42,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,830 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,831 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:42,851 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 26096b9ae816592d3ba6c249c461d108#family1#compaction#10 average throughput is 0.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:55:43,284 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/934a165e755045398f5ee01659c6a41e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/934a165e755045398f5ee01659c6a41e 2023-02-07 16:55:43,302 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 26096b9ae816592d3ba6c249c461d108/family1 of 26096b9ae816592d3ba6c249c461d108 into 934a165e755045398f5ee01659c6a41e(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:55:43,302 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:43,303 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1675788942798; duration=0sec 2023-02-07 16:55:43,304 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:55:43,316 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f5010ff6700c4221af0de35f0f4d90d1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205f5010ff6700c4221af0de35f0f4d90d1 2023-02-07 16:55:43,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:43,340 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:43,341 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:43,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a58458207c0746b8984b9a4b188ed47d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ddcecc0f89a54cbbbd6b3cd631a5e806, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/da77acffc0634bf798acc3c1b0fd4ad8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a244d2eed20a417c9dd23a251dce736b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a545d26ead6d481cb9370e12810f840b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/48fbbbabb09f47689ff47146c7e39c3b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/5b78f08e04e14cc498be9ba20e39f3f0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ea73850427564262a0f6d8ebd83b0240, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/2e3d1ff83eeb47c689c224158edc63ea, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/76326ac5d21444afbf45d0f77a239e27_SeqId_44_] to archive 2023-02-07 16:55:43,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:55:43,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a58458207c0746b8984b9a4b188ed47d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a58458207c0746b8984b9a4b188ed47d 2023-02-07 16:55:43,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ddcecc0f89a54cbbbd6b3cd631a5e806 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ddcecc0f89a54cbbbd6b3cd631a5e806 2023-02-07 16:55:43,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/da77acffc0634bf798acc3c1b0fd4ad8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/da77acffc0634bf798acc3c1b0fd4ad8 2023-02-07 16:55:43,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a244d2eed20a417c9dd23a251dce736b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a244d2eed20a417c9dd23a251dce736b 2023-02-07 16:55:43,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a545d26ead6d481cb9370e12810f840b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/a545d26ead6d481cb9370e12810f840b 2023-02-07 16:55:43,369 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0d4b1b39f3bf4db5a8f5a64664f25917 first=Optional[r00] last=Optional[r2] 2023-02-07 16:55:43,370 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0d4b1b39f3bf4db5a8f5a64664f25917}] 2023-02-07 16:55:43,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/48fbbbabb09f47689ff47146c7e39c3b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/48fbbbabb09f47689ff47146c7e39c3b 2023-02-07 16:55:43,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/5b78f08e04e14cc498be9ba20e39f3f0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/5b78f08e04e14cc498be9ba20e39f3f0 2023-02-07 16:55:43,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0d4b1b39f3bf4db5a8f5a64664f25917 for inclusion in 26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:43,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ea73850427564262a0f6d8ebd83b0240 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/ea73850427564262a0f6d8ebd83b0240 2023-02-07 16:55:43,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/2e3d1ff83eeb47c689c224158edc63ea to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/2e3d1ff83eeb47c689c224158edc63ea 2023-02-07 16:55:43,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-07 16:55:43,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:55:43,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/76326ac5d21444afbf45d0f77a239e27_SeqId_44_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/76326ac5d21444afbf45d0f77a239e27_SeqId_44_ 2023-02-07 16:55:43,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:43,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/0d4b1b39f3bf4db5a8f5a64664f25917 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ihhb177pl20a999dst7k4i0ijncdv0orcn8ndr6ijupum4c9j9krkubr0136o742/family1/0d4b1b39f3bf4db5a8f5a64664f25917 2023-02-07 16:55:43,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ihhb177pl20a999dst7k4i0ijncdv0orcn8ndr6ijupum4c9j9krkubr0136o742/family1/0d4b1b39f3bf4db5a8f5a64664f25917 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/16b97096a86346c98fb03973e4c00f14_SeqId_47_ 2023-02-07 16:55:43,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ihhb177pl20a999dst7k4i0ijncdv0orcn8ndr6ijupum4c9j9krkubr0136o742/family1/0d4b1b39f3bf4db5a8f5a64664f25917 into 26096b9ae816592d3ba6c249c461d108/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/16b97096a86346c98fb03973e4c00f14_SeqId_47_ - updating store file list. 2023-02-07 16:55:43,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/16b97096a86346c98fb03973e4c00f14_SeqId_47_ into 26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:43,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ihhb177pl20a999dst7k4i0ijncdv0orcn8ndr6ijupum4c9j9krkubr0136o742/family1/0d4b1b39f3bf4db5a8f5a64664f25917 into 26096b9ae816592d3ba6c249c461d108/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/16b97096a86346c98fb03973e4c00f14_SeqId_47_) 2023-02-07 16:55:43,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__ihhb177pl20a999dst7k4i0ijncdv0orcn8ndr6ijupum4c9j9krkubr0136o742/family1/0d4b1b39f3bf4db5a8f5a64664f25917 2023-02-07 16:55:43,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-07 16:55:43,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-07 16:55:43,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): 26096b9ae816592d3ba6c249c461d108/family1 is initiating minor compaction (all files) 2023-02-07 16:55:43,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@44537f05; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:55:43,396 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 26096b9ae816592d3ba6c249c461d108/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:43,396 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/3ce0ffd43d0a45d08bb88299cb3ecd97, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/934a165e755045398f5ee01659c6a41e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/16b97096a86346c98fb03973e4c00f14_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp, totalSize=358.6 K 2023-02-07 16:55:43,397 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 3ce0ffd43d0a45d08bb88299cb3ecd97, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828694 2023-02-07 16:55:43,397 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 934a165e755045398f5ee01659c6a41e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228694 2023-02-07 16:55:43,398 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 16b97096a86346c98fb03973e4c00f14_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878828694 2023-02-07 16:55:43,399 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:43,400 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:55:43,404 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130749ee4091c174c05aeea8dc02e0c40f3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130749ee4091c174c05aeea8dc02e0c40f3 2023-02-07 16:55:43,406 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512013ed4a17d7af6434f83fb5bf5a1b28c6f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512013ed4a17d7af6434f83fb5bf5a1b28c6f 2023-02-07 16:55:43,408 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c5a644ae2f2c4669a1f2c4a5ddbdbc52 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c5a644ae2f2c4669a1f2c4a5ddbdbc52 2023-02-07 16:55:43,408 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-07 16:55:43,408 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-07 16:55:43,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:43,409 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:43,409 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:55:43,410 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-07 16:55:43,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.6770 sec 2023-02-07 16:55:43,438 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 26096b9ae816592d3ba6c249c461d108#family1#compaction#11 average throughput is 6.88 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:55:43,577 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:43,577 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:43,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-07 16:55:43,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:44,007 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-07 16:55:44,009 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-07 16:55:44,009 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-07 16:55:44,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-07 16:55:44,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=26096b9ae816592d3ba6c249c461d108, REOPEN/MOVE}] 2023-02-07 16:55:44,027 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=26096b9ae816592d3ba6c249c461d108, REOPEN/MOVE 2023-02-07 16:55:44,028 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=26096b9ae816592d3ba6c249c461d108, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:44,028 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675788944027"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788944027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788944027"}]},"ts":"1675788944027"} 2023-02-07 16:55:44,030 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 26096b9ae816592d3ba6c249c461d108, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:55:44,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:44,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 26096b9ae816592d3ba6c249c461d108, disabling compactions & flushes 2023-02-07 16:55:44,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:44,694 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/.tmp/family1/473b012820814b7a9c3741883b82d35f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/473b012820814b7a9c3741883b82d35f 2023-02-07 16:55:44,701 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 26096b9ae816592d3ba6c249c461d108/family1 of 26096b9ae816592d3ba6c249c461d108 into 473b012820814b7a9c3741883b82d35f(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:55:44,701 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:44,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:44,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:44,701 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1675788943396; duration=1sec 2023-02-07 16:55:44,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. after waiting 0 ms 2023-02-07 16:55:44,701 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:55:44,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:44,704 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/3ce0ffd43d0a45d08bb88299cb3ecd97, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/934a165e755045398f5ee01659c6a41e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/16b97096a86346c98fb03973e4c00f14_SeqId_47_] to archive 2023-02-07 16:55:44,706 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:55:44,708 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/3ce0ffd43d0a45d08bb88299cb3ecd97 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/3ce0ffd43d0a45d08bb88299cb3ecd97 2023-02-07 16:55:44,710 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/934a165e755045398f5ee01659c6a41e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/934a165e755045398f5ee01659c6a41e 2023-02-07 16:55:44,712 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/16b97096a86346c98fb03973e4c00f14_SeqId_47_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/16b97096a86346c98fb03973e4c00f14_SeqId_47_ 2023-02-07 16:55:44,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-07 16:55:44,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:44,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 26096b9ae816592d3ba6c249c461d108: Waiting for close lock at 1675788944190Running coprocessor pre-close hooks at 1675788944190Disabling compacts and flushes for region at 1675788944190Disabling writes for close at 1675788944701 (+511 ms)Writing region close event to WAL at 1675788944715 (+14 ms)Running coprocessor post-close hooks at 1675788944719 (+4 ms)Closed at 1675788944720 (+1 ms) 2023-02-07 16:55:44,720 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 26096b9ae816592d3ba6c249c461d108 to self. 2023-02-07 16:55:44,722 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:44,723 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=26096b9ae816592d3ba6c249c461d108, regionState=CLOSED 2023-02-07 16:55:44,724 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675788944723"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788944723"}]},"ts":"1675788944723"} 2023-02-07 16:55:44,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-07 16:55:44,730 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 26096b9ae816592d3ba6c249c461d108, server=jenkins-hbase12.apache.org,33237,1675788923983 in 696 msec 2023-02-07 16:55:44,731 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=26096b9ae816592d3ba6c249c461d108, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=true 2023-02-07 16:55:44,882 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=26096b9ae816592d3ba6c249c461d108, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:44,882 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675788944882"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788944882"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788944882"}]},"ts":"1675788944882"} 2023-02-07 16:55:44,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 26096b9ae816592d3ba6c249c461d108, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:55:45,041 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:45,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 26096b9ae816592d3ba6c249c461d108, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:55:45,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:45,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:45,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:45,042 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:45,044 INFO [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:45,045 DEBUG [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:45,046 DEBUG [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:45,046 INFO [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26096b9ae816592d3ba6c249c461d108 columnFamilyName family1 2023-02-07 16:55:45,054 DEBUG [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/473b012820814b7a9c3741883b82d35f 2023-02-07 16:55:45,055 INFO [StoreOpener-26096b9ae816592d3ba6c249c461d108-1] regionserver.HStore(310): Store=26096b9ae816592d3ba6c249c461d108/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:45,056 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:45,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:45,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:55:45,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 26096b9ae816592d3ba6c249c461d108; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70627774, jitterRate=0.052435845136642456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:55:45,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 26096b9ae816592d3ba6c249c461d108: Running coprocessor pre-open hook at 1675788945042Writing region info on filesystem at 1675788945042Initializing all the Stores at 1675788945044 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675788945044Cleaning up temporary data from old regions at 1675788945057 (+13 ms)Cleaning up detritus from prior splits at 1675788945058 (+1 ms)Running coprocessor post-open hooks at 1675788945061 (+3 ms)Region opened successfully at 1675788945061 2023-02-07 16:55:45,062 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108., pid=17, masterSystemTime=1675788945037 2023-02-07 16:55:45,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:45,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:55:45,064 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=26096b9ae816592d3ba6c249c461d108, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:45,065 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675788945064"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788945064"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788945064"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788945064"}]},"ts":"1675788945064"} 2023-02-07 16:55:45,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-07 16:55:45,070 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 26096b9ae816592d3ba6c249c461d108, server=jenkins-hbase12.apache.org,33237,1675788923983 in 183 msec 2023-02-07 16:55:45,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-07 16:55:45,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=26096b9ae816592d3ba6c249c461d108, REOPEN/MOVE in 1.0440 sec 2023-02-07 16:55:45,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-07 16:55:45,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0600 sec 2023-02-07 16:55:45,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.4920 sec 2023-02-07 16:55:45,083 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:45,083 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:45,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-07 16:55:45,086 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:45,086 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:45,090 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:45,090 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:45,090 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(278): alter status finished 2023-02-07 16:55:45,092 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-07 16:55:45,094 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-07 16:55:45,094 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-07 16:55:45,095 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:55:45,095 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789545095 2023-02-07 16:55:45,096 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:55:45,097 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-07 16:55:45,097 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:45,097 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x52c882ee to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:55:45,123 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28164355, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:55:45,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:45,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:45,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:45,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:45,123 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:45,962 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284030081fb60a40c19eea12716ba4bb5c to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511284030081fb60a40c19eea12716ba4bb5c 2023-02-07 16:55:45,964 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:45,977 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:55:45,978 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:41688, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:55:45,986 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:45,987 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:45,987 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:55:45,990 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36482, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:55:46,002 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/354fd86ee075476d8c78cb4432734349 first=Optional[r05] last=Optional[r8] 2023-02-07 16:55:46,002 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/354fd86ee075476d8c78cb4432734349}] 2023-02-07 16:55:46,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/354fd86ee075476d8c78cb4432734349 for inclusion in 26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:46,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-07 16:55:46,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:55:46,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 26096b9ae816592d3ba6c249c461d108: 2023-02-07 16:55:46,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/354fd86ee075476d8c78cb4432734349 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pag1itq1t7p9po35p0809jkm4c5t291a9jottpml34so9v4ggjaspdt4h7n0131e/family1/354fd86ee075476d8c78cb4432734349 2023-02-07 16:55:46,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pag1itq1t7p9po35p0809jkm4c5t291a9jottpml34so9v4ggjaspdt4h7n0131e/family1/354fd86ee075476d8c78cb4432734349 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/680b1f116e444deabad7803f9dc42ce1_SeqId_53_ 2023-02-07 16:55:46,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pag1itq1t7p9po35p0809jkm4c5t291a9jottpml34so9v4ggjaspdt4h7n0131e/family1/354fd86ee075476d8c78cb4432734349 into 26096b9ae816592d3ba6c249c461d108/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/680b1f116e444deabad7803f9dc42ce1_SeqId_53_ - updating store file list. 2023-02-07 16:55:46,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/680b1f116e444deabad7803f9dc42ce1_SeqId_53_ into 26096b9ae816592d3ba6c249c461d108/family1 2023-02-07 16:55:46,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pag1itq1t7p9po35p0809jkm4c5t291a9jottpml34so9v4ggjaspdt4h7n0131e/family1/354fd86ee075476d8c78cb4432734349 into 26096b9ae816592d3ba6c249c461d108/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/family1/680b1f116e444deabad7803f9dc42ce1_SeqId_53_) 2023-02-07 16:55:46,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__pag1itq1t7p9po35p0809jkm4c5t291a9jottpml34so9v4ggjaspdt4h7n0131e/family1/354fd86ee075476d8c78cb4432734349 2023-02-07 16:55:46,024 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:46,026 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:55:46,027 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120823f3c78b550446a915d53ffc8693ae1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151120823f3c78b550446a915d53ffc8693ae1 2023-02-07 16:55:46,029 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511281cb352e835964dfb959b3eeb4a7c525e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511281cb352e835964dfb959b3eeb4a7c525e 2023-02-07 16:55:46,029 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-07 16:55:46,029 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-07 16:55:46,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:46,029 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:46,030 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-07 16:55:46,030 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-07 16:55:46,030 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:55:46,030 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-07 16:55:46,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 938 msec 2023-02-07 16:55:46,118 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=246 (was 210) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1185671507_15 at /127.0.0.1:55030 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54940 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:55074 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:55022 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54934 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf3131dc-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54904 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:55026 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc31d68-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54980 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase12:33237-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:55038 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54942 [Waiting for operation #23] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x03e0c654-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54926 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x52c882ee-SendThread(127.0.0.1:56335) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x03e0c654 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1713504678.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x52c882ee sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1713504678.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/cluster_25d3abf0-9a4f-edc9-863c-800af9aba25c/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54914 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf3131dc-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xf3131dc-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/cluster_25d3abf0-9a4f-edc9-863c-800af9aba25c/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54992 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x52c882ee-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: hconnection-0x7dc31d68-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x03e0c654-SendThread(127.0.0.1:56335) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:54886 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=580 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 243) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=3006 (was 3121) 2023-02-07 16:55:46,131 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=246, OpenFileDescriptor=580, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=171, AvailableMemoryMB=3005 2023-02-07 16:55:46,131 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:46,131 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:46,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-07 16:55:46,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:46,136 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:55:46,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-07 16:55:46,136 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:46,136 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:46,136 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:55:46,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-07 16:55:46,138 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:46,139 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a empty. 2023-02-07 16:55:46,139 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:46,139 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-07 16:55:46,237 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:46,238 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:46,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-07 16:55:46,439 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:46,439 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:46,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-07 16:55:46,549 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-07 16:55:46,551 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8f9dc8eed29220e9a82bfce30f2b288a, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:55:46,743 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:46,743 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:46,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-07 16:55:46,962 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 8f9dc8eed29220e9a82bfce30f2b288a, disabling compactions & flushes 2023-02-07 16:55:46,963 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. after waiting 0 ms 2023-02-07 16:55:46,963 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:46,964 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:46,964 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 8f9dc8eed29220e9a82bfce30f2b288a: Waiting for close lock at 1675788946963Disabling compacts and flushes for region at 1675788946963Disabling writes for close at 1675788946963Writing region close event to WAL at 1675788946964 (+1 ms)Closed at 1675788946964 2023-02-07 16:55:46,971 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:55:46,973 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675788946972"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788946972"}]},"ts":"1675788946972"} 2023-02-07 16:55:46,975 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:55:46,976 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:55:46,976 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788946976"}]},"ts":"1675788946976"} 2023-02-07 16:55:46,978 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-07 16:55:47,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8f9dc8eed29220e9a82bfce30f2b288a, ASSIGN}] 2023-02-07 16:55:47,003 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8f9dc8eed29220e9a82bfce30f2b288a, ASSIGN 2023-02-07 16:55:47,004 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8f9dc8eed29220e9a82bfce30f2b288a, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:55:47,155 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8f9dc8eed29220e9a82bfce30f2b288a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:47,155 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675788947155"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788947155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788947155"}]},"ts":"1675788947155"} 2023-02-07 16:55:47,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 8f9dc8eed29220e9a82bfce30f2b288a, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:55:47,247 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:47,247 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:47,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-07 16:55:47,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:47,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8f9dc8eed29220e9a82bfce30f2b288a, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:55:47,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:47,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:55:47,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:47,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:47,317 INFO [StoreOpener-8f9dc8eed29220e9a82bfce30f2b288a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:47,320 DEBUG [StoreOpener-8f9dc8eed29220e9a82bfce30f2b288a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1 2023-02-07 16:55:47,320 DEBUG [StoreOpener-8f9dc8eed29220e9a82bfce30f2b288a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1 2023-02-07 16:55:47,320 INFO [StoreOpener-8f9dc8eed29220e9a82bfce30f2b288a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f9dc8eed29220e9a82bfce30f2b288a columnFamilyName family1 2023-02-07 16:55:47,323 INFO [StoreOpener-8f9dc8eed29220e9a82bfce30f2b288a-1] regionserver.HStore(310): Store=8f9dc8eed29220e9a82bfce30f2b288a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:55:47,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:47,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:47,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:55:47,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:55:47,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 8f9dc8eed29220e9a82bfce30f2b288a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58898631, jitterRate=-0.12234200537204742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:55:47,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 8f9dc8eed29220e9a82bfce30f2b288a: Running coprocessor pre-open hook at 1675788947315Writing region info on filesystem at 1675788947315Initializing all the Stores at 1675788947317 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675788947317Cleaning up temporary data from old regions at 1675788947325 (+8 ms)Cleaning up detritus from prior splits at 1675788947326 (+1 ms)Running coprocessor post-open hooks at 1675788947330 (+4 ms)Region opened successfully at 1675788947330 2023-02-07 16:55:47,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a., pid=21, masterSystemTime=1675788947309 2023-02-07 16:55:47,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:47,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:47,333 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=8f9dc8eed29220e9a82bfce30f2b288a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:47,334 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675788947333"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788947333"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788947333"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788947333"}]},"ts":"1675788947333"} 2023-02-07 16:55:47,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-07 16:55:47,338 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 8f9dc8eed29220e9a82bfce30f2b288a, server=jenkins-hbase12.apache.org,33237,1675788923983 in 179 msec 2023-02-07 16:55:47,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-07 16:55:47,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=8f9dc8eed29220e9a82bfce30f2b288a, ASSIGN in 337 msec 2023-02-07 16:55:47,340 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:55:47,341 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788947340"}]},"ts":"1675788947340"} 2023-02-07 16:55:47,342 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-07 16:55:47,354 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:55:47,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.2210 sec 2023-02-07 16:55:48,249 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:48,249 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:48,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-07 16:55:48,250 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-07 16:55:48,282 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:48,282 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:48,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:48,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,285 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:48,285 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:48,286 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:48,286 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:48,286 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,286 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,296 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,296 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:48,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:48,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:48,296 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,296 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:48,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:48,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,297 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,297 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:48,297 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:48,298 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:48,298 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:48,298 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:48,298 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:48,298 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:48,299 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-07 16:55:48,329 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303c36d6aa182e42e5b38625f9cd8389ab to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303c36d6aa182e42e5b38625f9cd8389ab 2023-02-07 16:55:48,734 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/bfc977bc8e7e4b56a6af4de689f56c30 2023-02-07 16:55:48,740 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/bfc977bc8e7e4b56a6af4de689f56c30 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/bfc977bc8e7e4b56a6af4de689f56c30 2023-02-07 16:55:48,746 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/bfc977bc8e7e4b56a6af4de689f56c30, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-07 16:55:48,747 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 448ms, sequenceid=5, compaction requested=false 2023-02-07 16:55:48,747 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:48,749 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:48,749 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:48,749 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:48,749 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:48,749 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,749 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:48,749 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:48,759 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,759 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:48,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:48,759 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,759 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:48,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:48,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:48,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:48,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:48,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@35d516e[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:48,761 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:48,761 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,769 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,770 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:48,770 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,770 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:48,770 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:48,770 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:48,780 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:48,780 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,780 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:48,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:48,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:48,780 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:48,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:48,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:48,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:48,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:48,783 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:48,783 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:48,783 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:48,783 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,783 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:48,795 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,795 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,795 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:48,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:48,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:48,796 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:48,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,797 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:48,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,806 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,806 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:48,806 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,806 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:48,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:55:48,806 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:48,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:48,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:48,806 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:48,806 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,807 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:48,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:48,807 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:48,807 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,807 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:48,807 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,907 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:48,907 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:48,907 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:48,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:48,912 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:48,912 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:48,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:48,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:48,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,915 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:48,915 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:48,915 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:48,915 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:48,916 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,916 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,932 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,932 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:48,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:48,932 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:48,932 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:48,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:48,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,933 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,934 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:48,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:48,934 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:48,934 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:48,934 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:48,935 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:48,935 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:48,935 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:48,935 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:48,935 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-07 16:55:49,353 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f5fc3b50bce34329a1f0fd3f55d904a2 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f5fc3b50bce34329a1f0fd3f55d904a2 2023-02-07 16:55:49,362 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/44b3886a85a64be1b69e7277478b6d87 2023-02-07 16:55:49,371 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/44b3886a85a64be1b69e7277478b6d87 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/44b3886a85a64be1b69e7277478b6d87 2023-02-07 16:55:49,375 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/44b3886a85a64be1b69e7277478b6d87, entries=1, sequenceid=9, filesize=5.0 K 2023-02-07 16:55:49,376 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 441ms, sequenceid=9, compaction requested=false 2023-02-07 16:55:49,377 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:49,377 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:49,377 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:49,377 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:49,377 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,377 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:49,377 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:49,469 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,469 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:49,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:49,470 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,470 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:49,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:49,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:49,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:49,475 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:49,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53f5f0e6[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:49,476 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:49,476 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,595 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,596 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:49,596 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:49,596 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:49,596 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,596 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:49,606 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:49,606 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:49,606 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:49,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:49,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:49,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:49,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:49,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:49,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:49,617 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:49,617 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:49,617 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:49,617 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,618 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:49,627 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,627 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:49,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,627 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:49,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:49,628 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,630 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,672 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,672 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:49,673 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:49,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:49,673 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:55:49,673 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:49,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:49,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:49,673 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:49,673 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:49,673 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,675 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:49,675 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:49,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:49,675 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,675 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,775 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:49,775 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:49,775 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:49,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:49,782 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:49,782 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:49,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:49,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:49,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,785 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:49,785 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:49,786 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:49,786 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:49,787 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,787 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,806 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,806 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:49,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:49,806 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:49,806 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:49,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,807 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:49,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,808 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,808 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:49,808 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:49,808 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:49,808 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:49,809 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:49,809 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:49,809 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:49,809 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:49,809 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:49,809 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:50,237 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512012f163a52c7004e8fbb4eec1c849e9db3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012f163a52c7004e8fbb4eec1c849e9db3 2023-02-07 16:55:50,250 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:55:50,646 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/414938623f674b20bef63c6f4aaca8d4 2023-02-07 16:55:50,655 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/414938623f674b20bef63c6f4aaca8d4 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/414938623f674b20bef63c6f4aaca8d4 2023-02-07 16:55:50,661 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/414938623f674b20bef63c6f4aaca8d4, entries=1, sequenceid=13, filesize=4.9 K 2023-02-07 16:55:50,662 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 853ms, sequenceid=13, compaction requested=true 2023-02-07 16:55:50,662 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:50,662 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:50,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:50,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:50,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:50,662 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:50,711 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,711 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:50,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:50,712 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,712 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:50,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:50,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:50,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:50,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:50,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f0ad394[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:50,716 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:50,716 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,727 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:50,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:50,728 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:50,728 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,729 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:50,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:50,738 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:50,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:50,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:50,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:50,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:50,741 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:50,742 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:50,742 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:50,742 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,742 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:50,753 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,753 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:50,753 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:50,753 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:50,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,755 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,763 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,763 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:50,764 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:50,764 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:50,763 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,764 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:55:50,764 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:50,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:50,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:50,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:50,764 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,765 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:50,765 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:50,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:50,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:50,865 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:50,865 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:50,866 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:50,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:50,874 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:50,874 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:50,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:50,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:50,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,883 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:50,883 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:50,884 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:50,884 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:50,884 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,884 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,917 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,917 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:50,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:50,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:50,918 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:50,918 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:50,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,918 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:50,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,919 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,921 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:50,921 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:50,921 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:50,921 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:50,922 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:50,923 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:50,923 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:50,923 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:50,924 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:50,924 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:51,351 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205505f4f1c6a5846d3835c7efd5a080e7b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205505f4f1c6a5846d3835c7efd5a080e7b 2023-02-07 16:55:51,760 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/89fa517535774d0e9f72ce7342e9376d 2023-02-07 16:55:51,773 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/89fa517535774d0e9f72ce7342e9376d as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/89fa517535774d0e9f72ce7342e9376d 2023-02-07 16:55:51,782 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/89fa517535774d0e9f72ce7342e9376d, entries=1, sequenceid=17, filesize=4.9 K 2023-02-07 16:55:51,783 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 859ms, sequenceid=17, compaction requested=true 2023-02-07 16:55:51,784 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:51,784 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:51,784 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:51,784 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:51,784 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,784 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:51,784 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:51,921 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,921 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:51,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:51,922 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,922 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:51,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:51,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:51,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f079275[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:51,925 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:51,925 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,938 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,938 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:51,938 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:51,938 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:51,939 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,939 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:51,948 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:51,948 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,948 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:51,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:51,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:51,949 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:51,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:51,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:51,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:51,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:51,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:51,957 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:51,957 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:51,957 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:51,957 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,957 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:51,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:51,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,970 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:51,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:51,971 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,974 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:51,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,984 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,984 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:51,984 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:51,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:51,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:51,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:51,984 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:51,985 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:51,985 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,986 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:51,986 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:51,986 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:51,986 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:51,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:51,986 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:51,986 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,086 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:52,086 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:52,087 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:52,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:52,096 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:52,096 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:52,097 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:52,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:52,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,099 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:52,099 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:52,099 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:52,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:52,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,111 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:52,111 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:52,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:52,111 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:52,111 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:52,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:52,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,112 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,112 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:52,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:52,113 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:52,113 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:52,113 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:52,113 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:52,113 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:52,113 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:52,113 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:52,113 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:52,541 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228b70bf5101f5549adb79565216a2dd70f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228b70bf5101f5549adb79565216a2dd70f 2023-02-07 16:55:52,947 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/6fb48540c6b2419184596553d92f2f60 2023-02-07 16:55:52,960 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/6fb48540c6b2419184596553d92f2f60 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/6fb48540c6b2419184596553d92f2f60 2023-02-07 16:55:52,967 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/6fb48540c6b2419184596553d92f2f60, entries=1, sequenceid=21, filesize=4.9 K 2023-02-07 16:55:52,968 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 855ms, sequenceid=21, compaction requested=true 2023-02-07 16:55:52,968 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:52,968 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:52,968 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:52,968 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:52,968 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:52,968 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:52,968 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:53,016 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,016 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:53,016 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:53,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:53,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26b86cda[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:53,018 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:53,018 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,026 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,026 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,027 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:53,027 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:53,027 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:53,027 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,027 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:53,037 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:53,037 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:53,037 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:53,037 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:53,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:53,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:53,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:53,041 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:53,041 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:53,041 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:53,041 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,041 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:53,085 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,085 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:53,086 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:53,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:53,086 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,087 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,106 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:53,106 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:53,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:53,106 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:53,106 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,106 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:53,107 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:53,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:53,107 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:53,107 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:53,108 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,108 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,108 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:53,108 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:53,208 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:53,208 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:53,208 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:53,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:53,217 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:53,217 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:53,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:53,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:53,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,221 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:53,221 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:53,222 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:53,222 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:53,222 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,222 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:53,232 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:53,233 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:53,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,233 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:53,234 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:53,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,234 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,234 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:53,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:53,235 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:53,235 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:53,235 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:53,235 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:53,235 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:53,235 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:53,235 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:53,236 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:53,651 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123144fd2f9274524e6887b8e61b789ed5d4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123144fd2f9274524e6887b8e61b789ed5d4 2023-02-07 16:55:54,059 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/34b9f0ee06184a399a86ebd131a49eec 2023-02-07 16:55:54,070 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/34b9f0ee06184a399a86ebd131a49eec as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/34b9f0ee06184a399a86ebd131a49eec 2023-02-07 16:55:54,076 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/34b9f0ee06184a399a86ebd131a49eec, entries=1, sequenceid=25, filesize=4.9 K 2023-02-07 16:55:54,077 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 841ms, sequenceid=25, compaction requested=true 2023-02-07 16:55:54,077 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:54,077 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:54,077 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:54,077 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:54,077 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,077 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:54,077 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:54,185 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,185 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:54,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:54,186 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,186 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:54,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:54,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:54,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:54,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:54,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ab6da2b[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:54,189 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:54,189 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,201 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,201 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:54,201 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:54,201 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:54,201 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,201 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:54,211 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:54,211 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,211 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:54,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:54,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:54,211 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:54,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:54,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:54,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:54,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:54,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:54,215 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:54,215 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:54,215 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:54,215 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,215 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:54,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:54,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,227 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:54,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:54,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:54,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:54,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,228 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:54,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,237 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,237 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:54,237 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,237 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,237 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:55:54,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:54,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:54,237 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:54,237 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:54,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:54,237 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:54,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:54,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:54,238 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,239 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:54,239 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:54,239 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,339 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:54,339 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:54,340 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:54,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:54,347 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:54,348 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:54,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:54,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:54,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,352 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:54,352 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:54,353 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:54,353 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:54,353 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,354 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,363 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:54,363 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:54,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:54,364 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:54,364 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:54,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:54,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,365 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,365 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:54,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:54,366 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:54,366 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:54,366 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:54,367 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:54,367 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:54,367 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:54,367 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:54,367 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:54,791 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018a6d9fd783304a9c972dad94acbb3a55 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6d9fd783304a9c972dad94acbb3a55 2023-02-07 16:55:55,202 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/cfdf41bcd1194f15b1828cdeeb554f77 2023-02-07 16:55:55,214 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/cfdf41bcd1194f15b1828cdeeb554f77 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/cfdf41bcd1194f15b1828cdeeb554f77 2023-02-07 16:55:55,220 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/cfdf41bcd1194f15b1828cdeeb554f77, entries=1, sequenceid=29, filesize=4.9 K 2023-02-07 16:55:55,221 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 854ms, sequenceid=29, compaction requested=true 2023-02-07 16:55:55,221 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:55,221 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:55,222 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:55,222 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:55,222 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,222 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:55,222 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:55,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,232 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:55,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:55,233 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,233 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:55,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:55,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:55,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:55,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b9349a[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:55,236 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:55,237 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,247 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,248 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:55,248 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:55,248 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:55,248 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,248 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:55,258 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,258 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:55,258 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:55,258 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:55,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:55,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:55,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:55,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:55,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:55,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:55,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:55,267 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:55,268 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:55,268 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:55,268 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,268 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:55,279 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,279 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,279 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:55,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:55,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:55,281 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:55,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,284 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:55,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,300 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,300 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:55,300 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:55,300 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:55,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:55,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:55,300 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:55:55,300 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:55,301 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:55,301 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:55,300 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,301 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,301 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,301 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,301 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:55,401 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:55,401 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:55,401 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:55,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:55,410 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:55,410 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:55,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:55,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:55,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,414 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:55,414 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:55,415 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:55,415 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:55,415 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,415 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,426 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,426 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:55,426 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:55,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:55,427 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:55,427 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:55,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:55,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,428 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,429 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:55,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:55,429 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:55,429 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:55,430 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:55,430 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:55,430 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:55,430 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:55,430 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:55,430 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:55,853 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010389e0f43852fa470ea4e016d17fbe40d4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010389e0f43852fa470ea4e016d17fbe40d4 2023-02-07 16:55:56,262 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/fc8975be8aeb4f418254b638834f41eb 2023-02-07 16:55:56,275 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/fc8975be8aeb4f418254b638834f41eb as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/fc8975be8aeb4f418254b638834f41eb 2023-02-07 16:55:56,281 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/fc8975be8aeb4f418254b638834f41eb, entries=1, sequenceid=33, filesize=4.9 K 2023-02-07 16:55:56,282 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 852ms, sequenceid=33, compaction requested=true 2023-02-07 16:55:56,282 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:56,282 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:56,282 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:56,282 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:56,282 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,282 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:56,282 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:56,300 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,300 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:56,300 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,300 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:56,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:56,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:56,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:56,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:56,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@305e82a2[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:56,302 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:56,302 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,366 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,366 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,367 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:56,367 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:56,367 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,367 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:56,367 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:56,384 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:56,384 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,384 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:56,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:56,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:56,384 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:56,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:56,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:56,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:56,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:56,388 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:56,389 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:56,389 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:56,389 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,389 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:56,401 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,401 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,401 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:56,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:56,402 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:56,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:56,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,404 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:56,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,416 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,416 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:56,416 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:56,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:56,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:56,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:55:56,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:56,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:56,416 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:56,416 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,417 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,417 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:56,417 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,417 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:56,417 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,417 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:56,417 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,517 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:56,517 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:56,517 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:56,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:56,523 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:56,523 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:56,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:56,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:56,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,528 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:56,528 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:56,529 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:56,529 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:56,529 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,529 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,542 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,542 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:56,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:56,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:56,542 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:56,543 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:56,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:56,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,544 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:56,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:56,544 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:56,544 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:56,545 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:56,545 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:56,545 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:56,545 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:56,545 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:56,545 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:56,967 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907a18a25e408dd4a8690ffd444a4da486a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907a18a25e408dd4a8690ffd444a4da486a 2023-02-07 16:55:57,376 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/1817fee2a9514e19935c3196eabf494a 2023-02-07 16:55:57,387 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/1817fee2a9514e19935c3196eabf494a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/1817fee2a9514e19935c3196eabf494a 2023-02-07 16:55:57,395 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/1817fee2a9514e19935c3196eabf494a, entries=1, sequenceid=37, filesize=4.9 K 2023-02-07 16:55:57,396 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 851ms, sequenceid=37, compaction requested=true 2023-02-07 16:55:57,396 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:57,396 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:57,396 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:57,396 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:57,396 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,396 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:57,396 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:57,458 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,458 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:57,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:57,458 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,458 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:57,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:57,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:57,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:57,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:57,460 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5565f6cf[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:57,460 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:57,460 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,479 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,479 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:57,480 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:57,480 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:57,480 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,480 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:57,500 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:57,500 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:57,500 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:57,500 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:57,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:57,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:57,503 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:57,504 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:57,504 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:57,504 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:57,504 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,504 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:57,521 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,521 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:57,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:57,521 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:57,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:57,522 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:57,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,524 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:57,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,542 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,542 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:57,542 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,542 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:57,542 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:55:57,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:57,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:57,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:57,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:57,542 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:57,543 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,544 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,544 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:57,544 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:57,544 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:57,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:57,544 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,644 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:57,645 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:57,645 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:57,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:57,652 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:57,652 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:57,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:55:57,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:55:57,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,654 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:57,654 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:57,655 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:55:57,655 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:55:57,655 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,655 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,664 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:57,664 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:57,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:57,664 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:57,664 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:55:57,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:55:57,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,665 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,665 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:55:57,665 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:57,666 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:55:57,666 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:55:57,667 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:55:57,667 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:55:57,667 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:55:57,667 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:57,667 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. started... 2023-02-07 16:55:57,667 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8f9dc8eed29220e9a82bfce30f2b288a 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:55:58,085 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201025481a7dba4515acb6d2b1a99b845d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201025481a7dba4515acb6d2b1a99b845d 2023-02-07 16:55:58,495 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/e3e6ae59d5914496b6bca2f1b92e5eeb 2023-02-07 16:55:58,505 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/e3e6ae59d5914496b6bca2f1b92e5eeb as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e3e6ae59d5914496b6bca2f1b92e5eeb 2023-02-07 16:55:58,513 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e3e6ae59d5914496b6bca2f1b92e5eeb, entries=1, sequenceid=41, filesize=4.9 K 2023-02-07 16:55:58,514 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 8f9dc8eed29220e9a82bfce30f2b288a in 847ms, sequenceid=41, compaction requested=true 2023-02-07 16:55:58,514 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:58,514 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:58,514 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:55:58,515 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:55:58,515 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,515 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:55:58,515 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:55:58,563 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,563 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:58,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:58,564 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,564 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:55:58,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:58,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:58,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:58,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:55:58,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39ee19ca[Count = 0] remaining members to acquire global barrier 2023-02-07 16:55:58,569 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:55:58,569 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,580 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,580 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:55:58,580 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:55:58,580 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:55:58,580 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,581 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:55:58,595 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,595 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:55:58,595 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:58,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:58,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:58,595 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:55:58,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:58,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:58,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:58,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:55:58,606 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:55:58,606 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:55:58,606 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:55:58,606 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:55:58,606 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,606 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:55:58,615 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,615 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,615 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:55:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:55:58,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:58,616 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:55:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:55:58,618 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:55:58,632 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,632 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:55:58,632 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:55:58,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-07 16:55:58,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:55:58,632 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,632 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:55:58,633 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:55:58,633 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:55:58,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:55:58,634 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:55:58,634 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:55:58,634 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,634 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:55:58,634 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,634 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:55:58,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:55:58,734 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:55:58,734 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:58,734 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:55:58,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:55:58,738 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-07 16:55:58,741 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:55:58,742 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:55:58,744 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:55:58,744 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789558744 2023-02-07 16:55:58,746 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:55:58,749 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-07 16:55:58,749 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:55:58,750 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x01899a76 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:55:58,764 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b1f6df9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:55:58,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:55:59,605 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f65c74a49162409eb4090f86ac5c306e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f65c74a49162409eb4090f86ac5c306e 2023-02-07 16:55:59,607 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:55:59,622 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:55:59,623 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:58494, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:55:59,630 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:59,631 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:55:59,631 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:55:59,632 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:35108, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:55:59,643 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/504408e8ffb24743a1f417a4cfc5c289 first=Optional[r5] last=Optional[r6] 2023-02-07 16:55:59,644 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/504408e8ffb24743a1f417a4cfc5c289}] 2023-02-07 16:55:59,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/504408e8ffb24743a1f417a4cfc5c289 for inclusion in 8f9dc8eed29220e9a82bfce30f2b288a/family1 2023-02-07 16:55:59,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-07 16:55:59,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:55:59,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:59,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/504408e8ffb24743a1f417a4cfc5c289 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vb4n0ehcnmed222qm99jbrhr7t6k59j37ab5fgocqc6mv1ln497log7chkvn8cga/family1/504408e8ffb24743a1f417a4cfc5c289 2023-02-07 16:55:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vb4n0ehcnmed222qm99jbrhr7t6k59j37ab5fgocqc6mv1ln497log7chkvn8cga/family1/504408e8ffb24743a1f417a4cfc5c289 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_ 2023-02-07 16:55:59,656 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vb4n0ehcnmed222qm99jbrhr7t6k59j37ab5fgocqc6mv1ln497log7chkvn8cga/family1/504408e8ffb24743a1f417a4cfc5c289 into 8f9dc8eed29220e9a82bfce30f2b288a/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_ - updating store file list. 2023-02-07 16:55:59,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_ into 8f9dc8eed29220e9a82bfce30f2b288a/family1 2023-02-07 16:55:59,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vb4n0ehcnmed222qm99jbrhr7t6k59j37ab5fgocqc6mv1ln497log7chkvn8cga/family1/504408e8ffb24743a1f417a4cfc5c289 into 8f9dc8eed29220e9a82bfce30f2b288a/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_) 2023-02-07 16:55:59,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vb4n0ehcnmed222qm99jbrhr7t6k59j37ab5fgocqc6mv1ln497log7chkvn8cga/family1/504408e8ffb24743a1f417a4cfc5c289 2023-02-07 16:55:59,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-07 16:55:59,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-07 16:55:59,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): 8f9dc8eed29220e9a82bfce30f2b288a/family1 is initiating minor compaction 2023-02-07 16:55:59,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@15349174; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:55:59,665 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8f9dc8eed29220e9a82bfce30f2b288a/family1 in testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:55:59,666 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/44b3886a85a64be1b69e7277478b6d87, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/414938623f674b20bef63c6f4aaca8d4, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/89fa517535774d0e9f72ce7342e9376d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/6fb48540c6b2419184596553d92f2f60, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/34b9f0ee06184a399a86ebd131a49eec, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/cfdf41bcd1194f15b1828cdeeb554f77, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/fc8975be8aeb4f418254b638834f41eb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/1817fee2a9514e19935c3196eabf494a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e3e6ae59d5914496b6bca2f1b92e5eeb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp, totalSize=49.7 K 2023-02-07 16:55:59,666 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 44b3886a85a64be1b69e7277478b6d87, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-07 16:55:59,666 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 414938623f674b20bef63c6f4aaca8d4, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-07 16:55:59,666 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 89fa517535774d0e9f72ce7342e9376d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-07 16:55:59,666 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 6fb48540c6b2419184596553d92f2f60, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-07 16:55:59,666 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 34b9f0ee06184a399a86ebd131a49eec, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-07 16:55:59,667 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting cfdf41bcd1194f15b1828cdeeb554f77, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-07 16:55:59,667 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting fc8975be8aeb4f418254b638834f41eb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-07 16:55:59,667 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 1817fee2a9514e19935c3196eabf494a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-07 16:55:59,667 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting e3e6ae59d5914496b6bca2f1b92e5eeb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-07 16:55:59,667 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-07 16:55:59,668 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:55:59,669 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:55:59,670 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6d9fd783304a9c972dad94acbb3a55 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6d9fd783304a9c972dad94acbb3a55 2023-02-07 16:55:59,671 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010389e0f43852fa470ea4e016d17fbe40d4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010389e0f43852fa470ea4e016d17fbe40d4 2023-02-07 16:55:59,671 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-07 16:55:59,672 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-07 16:55:59,672 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:55:59,672 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:55:59,713 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8f9dc8eed29220e9a82bfce30f2b288a#family1#compaction#22 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:55:59,736 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/af9aad9cd1f8409d8e0dab4d9fc9447e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/af9aad9cd1f8409d8e0dab4d9fc9447e 2023-02-07 16:55:59,744 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 8f9dc8eed29220e9a82bfce30f2b288a/family1 of 8f9dc8eed29220e9a82bfce30f2b288a into af9aad9cd1f8409d8e0dab4d9fc9447e(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:55:59,744 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:55:59,744 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675788959665; duration=0sec 2023-02-07 16:55:59,744 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:55:59,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/44b3886a85a64be1b69e7277478b6d87, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/414938623f674b20bef63c6f4aaca8d4, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/89fa517535774d0e9f72ce7342e9376d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/6fb48540c6b2419184596553d92f2f60, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/34b9f0ee06184a399a86ebd131a49eec, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/cfdf41bcd1194f15b1828cdeeb554f77, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/fc8975be8aeb4f418254b638834f41eb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/1817fee2a9514e19935c3196eabf494a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e3e6ae59d5914496b6bca2f1b92e5eeb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_] to archive 2023-02-07 16:55:59,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:55:59,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/44b3886a85a64be1b69e7277478b6d87 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/44b3886a85a64be1b69e7277478b6d87 2023-02-07 16:55:59,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/414938623f674b20bef63c6f4aaca8d4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/414938623f674b20bef63c6f4aaca8d4 2023-02-07 16:55:59,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/89fa517535774d0e9f72ce7342e9376d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/89fa517535774d0e9f72ce7342e9376d 2023-02-07 16:55:59,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/6fb48540c6b2419184596553d92f2f60 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/6fb48540c6b2419184596553d92f2f60 2023-02-07 16:55:59,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/34b9f0ee06184a399a86ebd131a49eec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/34b9f0ee06184a399a86ebd131a49eec 2023-02-07 16:55:59,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/cfdf41bcd1194f15b1828cdeeb554f77 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/cfdf41bcd1194f15b1828cdeeb554f77 2023-02-07 16:55:59,768 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/fc8975be8aeb4f418254b638834f41eb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/fc8975be8aeb4f418254b638834f41eb 2023-02-07 16:55:59,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/1817fee2a9514e19935c3196eabf494a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/1817fee2a9514e19935c3196eabf494a 2023-02-07 16:55:59,771 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e3e6ae59d5914496b6bca2f1b92e5eeb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e3e6ae59d5914496b6bca2f1b92e5eeb 2023-02-07 16:55:59,773 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/b088a85cdbc346f48ccc4fc682e3118b_SeqId_44_ 2023-02-07 16:56:00,555 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314a994512bed74ffbaf62886ea854d811 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512314a994512bed74ffbaf62886ea854d811 2023-02-07 16:56:00,556 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:56:00,572 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:00,573 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:00,582 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/2521b9a80eba4723b238afb5098ae836 first=Optional[r1] last=Optional[r4] 2023-02-07 16:56:00,583 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/2521b9a80eba4723b238afb5098ae836}] 2023-02-07 16:56:00,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/2521b9a80eba4723b238afb5098ae836 for inclusion in 8f9dc8eed29220e9a82bfce30f2b288a/family1 2023-02-07 16:56:00,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-07 16:56:00,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:00,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:56:00,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/2521b9a80eba4723b238afb5098ae836 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vg2p0fvb4dd6n1magb2dn9jiqvhk9csk9mtdgl4c753uoqib02hen8mgclnrrkjd/family1/2521b9a80eba4723b238afb5098ae836 2023-02-07 16:56:00,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vg2p0fvb4dd6n1magb2dn9jiqvhk9csk9mtdgl4c753uoqib02hen8mgclnrrkjd/family1/2521b9a80eba4723b238afb5098ae836 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e929f19ae32d456d9fafd196772f812f_SeqId_47_ 2023-02-07 16:56:00,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vg2p0fvb4dd6n1magb2dn9jiqvhk9csk9mtdgl4c753uoqib02hen8mgclnrrkjd/family1/2521b9a80eba4723b238afb5098ae836 into 8f9dc8eed29220e9a82bfce30f2b288a/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e929f19ae32d456d9fafd196772f812f_SeqId_47_ - updating store file list. 2023-02-07 16:56:00,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e929f19ae32d456d9fafd196772f812f_SeqId_47_ into 8f9dc8eed29220e9a82bfce30f2b288a/family1 2023-02-07 16:56:00,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vg2p0fvb4dd6n1magb2dn9jiqvhk9csk9mtdgl4c753uoqib02hen8mgclnrrkjd/family1/2521b9a80eba4723b238afb5098ae836 into 8f9dc8eed29220e9a82bfce30f2b288a/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e929f19ae32d456d9fafd196772f812f_SeqId_47_) 2023-02-07 16:56:00,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__vg2p0fvb4dd6n1magb2dn9jiqvhk9csk9mtdgl4c753uoqib02hen8mgclnrrkjd/family1/2521b9a80eba4723b238afb5098ae836 2023-02-07 16:56:00,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-07 16:56:00,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-07 16:56:00,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): 8f9dc8eed29220e9a82bfce30f2b288a/family1 is initiating minor compaction (all files) 2023-02-07 16:56:00,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@64286795; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:00,606 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 8f9dc8eed29220e9a82bfce30f2b288a/family1 in testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:56:00,607 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/bfc977bc8e7e4b56a6af4de689f56c30, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/af9aad9cd1f8409d8e0dab4d9fc9447e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e929f19ae32d456d9fafd196772f812f_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp, totalSize=178.1 K 2023-02-07 16:56:00,607 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting bfc977bc8e7e4b56a6af4de689f56c30, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828694 2023-02-07 16:56:00,608 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting af9aad9cd1f8409d8e0dab4d9fc9447e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228694 2023-02-07 16:56:00,609 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting e929f19ae32d456d9fafd196772f812f_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965228694 2023-02-07 16:56:00,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:56:00,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:00,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012f163a52c7004e8fbb4eec1c849e9db3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512012f163a52c7004e8fbb4eec1c849e9db3 2023-02-07 16:56:00,613 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205505f4f1c6a5846d3835c7efd5a080e7b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205505f4f1c6a5846d3835c7efd5a080e7b 2023-02-07 16:56:00,615 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228b70bf5101f5549adb79565216a2dd70f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228b70bf5101f5549adb79565216a2dd70f 2023-02-07 16:56:00,616 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123144fd2f9274524e6887b8e61b789ed5d4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015123144fd2f9274524e6887b8e61b789ed5d4 2023-02-07 16:56:00,616 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-07 16:56:00,616 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-07 16:56:00,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:56:00,617 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:56:00,634 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 8f9dc8eed29220e9a82bfce30f2b288a#family1#compaction#23 average throughput is 11.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:56:01,498 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511304d6bff9480844cbaaf6097c7775f5449 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511304d6bff9480844cbaaf6097c7775f5449 2023-02-07 16:56:01,499 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:56:01,517 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:01,517 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:01,526 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/756c259a532d43e8b1717bf88d4cdc39 first=Optional[r00] last=Optional[r8] 2023-02-07 16:56:01,526 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/756c259a532d43e8b1717bf88d4cdc39}] 2023-02-07 16:56:01,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/756c259a532d43e8b1717bf88d4cdc39 for inclusion in 8f9dc8eed29220e9a82bfce30f2b288a/family1 2023-02-07 16:56:01,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-07 16:56:01,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:01,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:56:01,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/756c259a532d43e8b1717bf88d4cdc39 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8ctvijnvk1h0qu98pp667n8rrngcoqbo6l7c5sqtugtp7g8uvlas8vdsejqaan1n/family1/756c259a532d43e8b1717bf88d4cdc39 2023-02-07 16:56:01,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8ctvijnvk1h0qu98pp667n8rrngcoqbo6l7c5sqtugtp7g8uvlas8vdsejqaan1n/family1/756c259a532d43e8b1717bf88d4cdc39 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/7c139656db6a4deb804031f863980b1c_SeqId_49_ 2023-02-07 16:56:01,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8ctvijnvk1h0qu98pp667n8rrngcoqbo6l7c5sqtugtp7g8uvlas8vdsejqaan1n/family1/756c259a532d43e8b1717bf88d4cdc39 into 8f9dc8eed29220e9a82bfce30f2b288a/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/7c139656db6a4deb804031f863980b1c_SeqId_49_ - updating store file list. 2023-02-07 16:56:01,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/7c139656db6a4deb804031f863980b1c_SeqId_49_ into 8f9dc8eed29220e9a82bfce30f2b288a/family1 2023-02-07 16:56:01,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8ctvijnvk1h0qu98pp667n8rrngcoqbo6l7c5sqtugtp7g8uvlas8vdsejqaan1n/family1/756c259a532d43e8b1717bf88d4cdc39 into 8f9dc8eed29220e9a82bfce30f2b288a/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/7c139656db6a4deb804031f863980b1c_SeqId_49_) 2023-02-07 16:56:01,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8ctvijnvk1h0qu98pp667n8rrngcoqbo6l7c5sqtugtp7g8uvlas8vdsejqaan1n/family1/756c259a532d43e8b1717bf88d4cdc39 2023-02-07 16:56:01,547 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:56:01,548 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:01,549 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201025481a7dba4515acb6d2b1a99b845d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511201025481a7dba4515acb6d2b1a99b845d 2023-02-07 16:56:01,551 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f5fc3b50bce34329a1f0fd3f55d904a2 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128f5fc3b50bce34329a1f0fd3f55d904a2 2023-02-07 16:56:01,552 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303c36d6aa182e42e5b38625f9cd8389ab to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511303c36d6aa182e42e5b38625f9cd8389ab 2023-02-07 16:56:01,552 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-07 16:56:01,552 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-07 16:56:01,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:56:01,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:56:01,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:56:01,553 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:56:01,553 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:01,554 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:56:01,555 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.8140 sec 2023-02-07 16:56:01,660 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=252 (was 246) Potentially hanging thread: hconnection-0x1da60097-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x01899a76-SendThread(127.0.0.1:56335) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57342 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57264 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1185671507_15 at /127.0.0.1:57354 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57292 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x01899a76 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/1713504678.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57410 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57418 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57236 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57346 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57284 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1da60097-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1da60097-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57472 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57328 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57366 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1185671507_15 at /127.0.0.1:57420 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/e77bba09fade464c9d87caa54b7bd15b java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57298 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1da60097-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57380 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1da60097-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1da60097-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_128651487_15 at /127.0.0.1:57476 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:56335@0x01899a76-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1da60097-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=605 (was 580) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=290 (was 308), ProcessCount=171 (was 171), AvailableMemoryMB=2863 (was 3005) 2023-02-07 16:56:01,670 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=252, OpenFileDescriptor=605, MaxFileDescriptor=60000, SystemLoadAverage=290, ProcessCount=171, AvailableMemoryMB=2863 2023-02-07 16:56:01,671 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:01,671 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:01,672 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-07 16:56:01,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:01,675 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:56:01,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-07 16:56:01,676 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:01,676 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:01,676 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:56:01,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-07 16:56:01,677 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:01,678 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0 empty. 2023-02-07 16:56:01,679 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:01,679 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-07 16:56:01,777 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:01,777 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:01,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-07 16:56:01,860 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/.tmp/family1/e77bba09fade464c9d87caa54b7bd15b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e77bba09fade464c9d87caa54b7bd15b 2023-02-07 16:56:01,867 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 8f9dc8eed29220e9a82bfce30f2b288a/family1 of 8f9dc8eed29220e9a82bfce30f2b288a into e77bba09fade464c9d87caa54b7bd15b(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:56:01,867 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 8f9dc8eed29220e9a82bfce30f2b288a: 2023-02-07 16:56:01,867 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675788960606; duration=1sec 2023-02-07 16:56:01,867 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:01,947 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/bfc977bc8e7e4b56a6af4de689f56c30, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/af9aad9cd1f8409d8e0dab4d9fc9447e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e929f19ae32d456d9fafd196772f812f_SeqId_47_] to archive 2023-02-07 16:56:01,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:01,951 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/bfc977bc8e7e4b56a6af4de689f56c30 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/bfc977bc8e7e4b56a6af4de689f56c30 2023-02-07 16:56:01,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/af9aad9cd1f8409d8e0dab4d9fc9447e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/af9aad9cd1f8409d8e0dab4d9fc9447e 2023-02-07 16:56:01,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e929f19ae32d456d9fafd196772f812f_SeqId_47_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/family1/e929f19ae32d456d9fafd196772f812f_SeqId_47_ 2023-02-07 16:56:01,979 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:01,979 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:01,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-07 16:56:02,087 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-07 16:56:02,089 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1eadc5198d8681736e2d7b473d06dfe0, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:56:02,097 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:02,097 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 1eadc5198d8681736e2d7b473d06dfe0, disabling compactions & flushes 2023-02-07 16:56:02,097 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:02,097 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:02,097 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. after waiting 0 ms 2023-02-07 16:56:02,097 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:02,097 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:02,097 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 1eadc5198d8681736e2d7b473d06dfe0: Waiting for close lock at 1675788962097Disabling compacts and flushes for region at 1675788962097Disabling writes for close at 1675788962097Writing region close event to WAL at 1675788962097Closed at 1675788962097 2023-02-07 16:56:02,100 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:56:02,102 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675788962102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788962102"}]},"ts":"1675788962102"} 2023-02-07 16:56:02,104 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:56:02,105 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:56:02,105 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788962105"}]},"ts":"1675788962105"} 2023-02-07 16:56:02,107 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-07 16:56:02,280 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:02,280 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:02,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-07 16:56:02,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1eadc5198d8681736e2d7b473d06dfe0, ASSIGN}] 2023-02-07 16:56:02,358 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1eadc5198d8681736e2d7b473d06dfe0, ASSIGN 2023-02-07 16:56:02,360 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1eadc5198d8681736e2d7b473d06dfe0, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:56:02,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=1eadc5198d8681736e2d7b473d06dfe0, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:02,511 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675788962511"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788962511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788962511"}]},"ts":"1675788962511"} 2023-02-07 16:56:02,515 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 1eadc5198d8681736e2d7b473d06dfe0, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:02,671 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:02,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1eadc5198d8681736e2d7b473d06dfe0, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:56:02,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:02,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:02,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:02,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:02,674 INFO [StoreOpener-1eadc5198d8681736e2d7b473d06dfe0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:02,675 DEBUG [StoreOpener-1eadc5198d8681736e2d7b473d06dfe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1 2023-02-07 16:56:02,675 DEBUG [StoreOpener-1eadc5198d8681736e2d7b473d06dfe0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1 2023-02-07 16:56:02,676 INFO [StoreOpener-1eadc5198d8681736e2d7b473d06dfe0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1eadc5198d8681736e2d7b473d06dfe0 columnFamilyName family1 2023-02-07 16:56:02,677 INFO [StoreOpener-1eadc5198d8681736e2d7b473d06dfe0-1] regionserver.HStore(310): Store=1eadc5198d8681736e2d7b473d06dfe0/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:02,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:02,678 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:02,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:56:02,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:56:02,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1eadc5198d8681736e2d7b473d06dfe0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61193513, jitterRate=-0.08814559876918793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:56:02,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1eadc5198d8681736e2d7b473d06dfe0: Running coprocessor pre-open hook at 1675788962672Writing region info on filesystem at 1675788962672Initializing all the Stores at 1675788962673 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675788962673Cleaning up temporary data from old regions at 1675788962679 (+6 ms)Cleaning up detritus from prior splits at 1675788962679Running coprocessor post-open hooks at 1675788962683 (+4 ms)Region opened successfully at 1675788962683 2023-02-07 16:56:02,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0., pid=25, masterSystemTime=1675788962668 2023-02-07 16:56:02,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:02,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:02,686 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=1eadc5198d8681736e2d7b473d06dfe0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:02,686 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675788962686"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788962686"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788962686"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788962686"}]},"ts":"1675788962686"} 2023-02-07 16:56:02,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-07 16:56:02,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 1eadc5198d8681736e2d7b473d06dfe0, server=jenkins-hbase12.apache.org,33237,1675788923983 in 174 msec 2023-02-07 16:56:02,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-07 16:56:02,692 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=1eadc5198d8681736e2d7b473d06dfe0, ASSIGN in 338 msec 2023-02-07 16:56:02,692 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:56:02,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788962692"}]},"ts":"1675788962692"} 2023-02-07 16:56:02,694 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-07 16:56:02,782 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:56:02,784 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:02,784 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:02,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.1100 sec 2023-02-07 16:56:02,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-07 16:56:02,786 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-07 16:56:02,811 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:02,811 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:02,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:02,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:02,813 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:02,813 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:02,813 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:02,813 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:02,814 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:02,814 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:02,826 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:02,826 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:02,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:02,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:02,826 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:02,826 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:02,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:02,827 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:02,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:02,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:02,827 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:02,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:02,827 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:02,827 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:02,828 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:02,828 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:02,828 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:02,828 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:02,828 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:02,829 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-07 16:56:03,257 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130326fe9adfb234b2590571ab2738beb52 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130326fe9adfb234b2590571ab2738beb52 2023-02-07 16:56:03,682 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/a6f0f1a76645475db149109694bd8f0f 2023-02-07 16:56:03,682 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:56:03,682 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01899a76 to 127.0.0.1:56335 2023-02-07 16:56:03,682 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:56:03,683 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:56:03,683 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52c882ee to 127.0.0.1:56335 2023-02-07 16:56:03,683 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:56:03,683 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:56:03,683 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03e0c654 to 127.0.0.1:56335 2023-02-07 16:56:03,683 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:56:03,687 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/a6f0f1a76645475db149109694bd8f0f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/a6f0f1a76645475db149109694bd8f0f 2023-02-07 16:56:03,692 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/a6f0f1a76645475db149109694bd8f0f, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-07 16:56:03,694 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 865ms, sequenceid=5, compaction requested=false 2023-02-07 16:56:03,694 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:03,694 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:03,694 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:03,694 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:03,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:03,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:03,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:03,783 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,783 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:03,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:03,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:03,875 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,875 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:03,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:03,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33f9f789[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:03,877 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:03,877 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,889 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:03,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:03,889 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,889 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:03,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:03,899 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:03,899 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:03,899 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,899 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:03,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:03,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:03,902 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:03,902 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:03,902 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:03,902 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,902 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:03,910 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,910 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:03,910 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:03,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:03,911 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:03,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:03,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:03,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,912 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:03,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,920 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,920 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:03,920 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:03,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:03,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:03,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:03,920 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:03,920 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,920 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:03,921 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:03,921 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,921 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:03,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:03,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:03,921 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:03,921 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:03,921 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,021 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:04,021 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:04,022 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:04,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:04,029 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:04,029 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:04,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:04,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:04,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,033 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:04,033 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:04,033 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:04,033 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:04,034 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,034 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,047 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:04,047 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:04,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:04,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:04,048 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:04,048 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:04,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:04,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,050 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,051 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:04,051 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:04,051 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:04,051 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:04,051 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:04,052 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:04,052 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:04,052 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:04,052 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:04,052 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-07 16:56:04,479 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287ca50f2096384184ab663ef1c054316a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511287ca50f2096384184ab663ef1c054316a 2023-02-07 16:56:04,888 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/c5e25f7bc61943ec967390ac1678111d 2023-02-07 16:56:04,902 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/c5e25f7bc61943ec967390ac1678111d as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/c5e25f7bc61943ec967390ac1678111d 2023-02-07 16:56:04,910 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/c5e25f7bc61943ec967390ac1678111d, entries=1, sequenceid=9, filesize=5.0 K 2023-02-07 16:56:04,911 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 859ms, sequenceid=9, compaction requested=false 2023-02-07 16:56:04,912 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:04,912 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:04,912 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:04,912 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:04,912 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:04,912 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:04,912 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:05,106 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,106 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:05,106 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,106 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:05,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:05,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:05,108 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77f638c6[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:05,108 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:05,108 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,173 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,173 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:05,174 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:05,174 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:05,174 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,174 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:05,183 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:05,184 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,184 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:05,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:05,184 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:05,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:05,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:05,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:05,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:05,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:05,190 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:05,190 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:05,190 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:05,190 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,190 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:05,204 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,204 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:05,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,204 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:05,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:05,205 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,207 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,221 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,221 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,221 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,222 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:05,221 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:05,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:05,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:05,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:05,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:05,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:05,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:05,222 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:05,223 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:05,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:05,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:05,323 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:05,323 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:05,323 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:05,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:05,331 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:05,331 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:05,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:05,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:05,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,334 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:05,334 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:05,334 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:05,334 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:05,335 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,335 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,341 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,341 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:05,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:05,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:05,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:05,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:05,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,342 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,343 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:05,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:05,343 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:05,343 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:05,343 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:05,343 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:05,343 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:05,343 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:05,343 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:05,343 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:05,761 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b635fa507947456f963fd04ba58fd445 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b635fa507947456f963fd04ba58fd445 2023-02-07 16:56:06,167 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/7f7fe805909d4e38adf0138bc436e036 2023-02-07 16:56:06,179 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/7f7fe805909d4e38adf0138bc436e036 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/7f7fe805909d4e38adf0138bc436e036 2023-02-07 16:56:06,188 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/7f7fe805909d4e38adf0138bc436e036, entries=1, sequenceid=13, filesize=4.9 K 2023-02-07 16:56:06,189 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 846ms, sequenceid=13, compaction requested=true 2023-02-07 16:56:06,189 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:06,189 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:06,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:06,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:06,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:06,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:06,271 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,271 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:06,272 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,272 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:06,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:06,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:06,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:06,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:06,278 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d5f7b79[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:06,278 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:06,279 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,316 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:06,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:06,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:06,317 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,318 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:06,331 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:06,331 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:06,331 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:06,331 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:06,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:06,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:06,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:06,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:06,342 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:06,342 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:06,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:06,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:06,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,342 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:06,383 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,383 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:06,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,384 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:06,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:06,386 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:06,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:06,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,390 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:06,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,411 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,411 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,411 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,411 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:06,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:06,411 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:06,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:06,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:06,411 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:06,411 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:06,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:06,411 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,412 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,412 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:06,412 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,412 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:06,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:06,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:06,512 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:06,512 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:06,512 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:06,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:06,520 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:06,521 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:06,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:06,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:06,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,523 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:06,523 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:06,523 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:06,523 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:06,524 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,524 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,531 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,531 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:06,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:06,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:06,531 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:06,531 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:06,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,532 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:06,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,532 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,533 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:06,533 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:06,533 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:06,533 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:06,533 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:06,533 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:06,533 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:06,533 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:06,533 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:06,534 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:06,954 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120522add548049d49c9af2235065d4574cb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120522add548049d49c9af2235065d4574cb 2023-02-07 16:56:07,363 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/04e5c67051a64c6389bb63254f84495e 2023-02-07 16:56:07,368 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/04e5c67051a64c6389bb63254f84495e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/04e5c67051a64c6389bb63254f84495e 2023-02-07 16:56:07,374 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/04e5c67051a64c6389bb63254f84495e, entries=1, sequenceid=17, filesize=4.9 K 2023-02-07 16:56:07,375 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 841ms, sequenceid=17, compaction requested=true 2023-02-07 16:56:07,375 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:07,375 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:07,375 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:07,375 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:07,375 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,375 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:07,375 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:07,425 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,425 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:07,426 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,426 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:07,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:07,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:07,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44b60351[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:07,427 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:07,428 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,436 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,436 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:07,436 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:07,436 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,436 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:07,436 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:07,446 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:07,446 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,446 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:07,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:07,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:07,447 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:07,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:07,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:07,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:07,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:07,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:07,448 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:07,449 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:07,449 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:07,449 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,449 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:07,457 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,457 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,457 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:07,457 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:07,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,458 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:07,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:07,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,459 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:07,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,467 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,467 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,468 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:07,467 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:07,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:07,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:07,468 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:07,468 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:07,468 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,468 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,468 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,468 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,468 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:07,468 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:07,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:07,468 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:07,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:07,568 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:07,569 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:07,569 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:07,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:07,572 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:07,572 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:07,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:07,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:07,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,575 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:07,575 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:07,575 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:07,575 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:07,575 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,576 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,583 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:07,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:07,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:07,583 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,584 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:07,584 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:07,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:07,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,585 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,585 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:07,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:07,586 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:07,586 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:07,586 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:07,586 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:07,586 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:07,586 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:07,586 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:07,586 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:08,003 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f98e48216cbe4b3e97f974519c955d5d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f98e48216cbe4b3e97f974519c955d5d 2023-02-07 16:56:08,204 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:56:08,409 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/54f95390dca7425492b25e05f786b12f 2023-02-07 16:56:08,414 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/54f95390dca7425492b25e05f786b12f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/54f95390dca7425492b25e05f786b12f 2023-02-07 16:56:08,419 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/54f95390dca7425492b25e05f786b12f, entries=1, sequenceid=21, filesize=4.9 K 2023-02-07 16:56:08,420 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 834ms, sequenceid=21, compaction requested=true 2023-02-07 16:56:08,420 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:08,420 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:08,420 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:08,420 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:08,420 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,420 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:08,420 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:08,467 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,467 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:08,468 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:08,468 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:08,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:08,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:08,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:08,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@388ff1f1[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:08,471 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:08,471 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,511 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,511 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:08,511 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:08,511 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:08,511 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,511 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:08,530 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:08,531 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:08,530 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,531 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:08,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:08,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:08,533 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:08,533 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:08,533 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:08,533 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,533 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:08,541 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,541 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,541 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:08,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:08,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:08,542 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:08,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:08,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,544 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,551 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,551 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:08,552 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:08,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:08,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:08,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:08,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,552 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:08,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:08,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:08,652 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:08,653 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:08,653 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:08,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:08,657 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:08,657 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:08,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:08,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:08,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,660 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:08,660 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:08,660 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:08,660 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:08,660 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,660 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,667 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,667 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:08,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:08,668 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:08,668 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,668 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:08,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,669 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,669 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:08,669 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:08,669 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:08,669 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:08,669 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:08,670 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:08,670 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:08,670 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:08,670 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:08,670 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:09,084 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c1aefd0a2ea74d5d8b53024d2ee417c4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1aefd0a2ea74d5d8b53024d2ee417c4 2023-02-07 16:56:09,490 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/eeef7152edeb40db903d2d369c209fed 2023-02-07 16:56:09,498 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/eeef7152edeb40db903d2d369c209fed as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/eeef7152edeb40db903d2d369c209fed 2023-02-07 16:56:09,505 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/eeef7152edeb40db903d2d369c209fed, entries=1, sequenceid=25, filesize=4.9 K 2023-02-07 16:56:09,506 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 836ms, sequenceid=25, compaction requested=true 2023-02-07 16:56:09,506 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:09,506 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:09,506 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:09,506 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:09,506 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,506 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:09,506 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:09,556 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,557 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:09,557 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,558 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:09,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:09,561 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:09,562 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ef9ce2e[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:09,562 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:09,562 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,642 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:09,642 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:09,642 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:09,642 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,642 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:09,758 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:09,758 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:09,758 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:09,758 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:09,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:09,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:09,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:09,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:09,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:09,770 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:09,770 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:09,770 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:09,770 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:09,770 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,770 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:09,825 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,825 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:09,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,826 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:09,826 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:09,826 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:09,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,829 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:09,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:09,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:09,853 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:09,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:09,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:09,853 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,853 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:09,854 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:09,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:09,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:09,954 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:09,954 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:09,954 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:09,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:09,962 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:09,962 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:09,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:09,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:09,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,966 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:09,966 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:09,966 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:09,966 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:09,967 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,967 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,990 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,990 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:09,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:09,990 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:09,990 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:09,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,991 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:09,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,991 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,991 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:09,991 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:09,991 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:09,991 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:09,991 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:09,992 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:09,992 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:09,992 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:09,992 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:09,992 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:10,409 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019149d36968d94f86b24fe92def67d96a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019149d36968d94f86b24fe92def67d96a 2023-02-07 16:56:10,817 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/3e61398f9e2c484781e6d6a251767aae 2023-02-07 16:56:10,824 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/3e61398f9e2c484781e6d6a251767aae as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3e61398f9e2c484781e6d6a251767aae 2023-02-07 16:56:10,829 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3e61398f9e2c484781e6d6a251767aae, entries=1, sequenceid=29, filesize=4.9 K 2023-02-07 16:56:10,830 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 838ms, sequenceid=29, compaction requested=true 2023-02-07 16:56:10,830 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:10,830 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:10,830 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:10,830 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:10,830 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,831 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:10,831 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:10,896 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,897 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:10,897 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,897 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:10,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:10,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:10,899 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@80bf63b[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:10,899 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:10,899 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,926 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,927 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:10,927 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:10,927 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,927 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:10,927 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:10,937 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:10,937 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:10,937 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,937 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:10,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:10,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:10,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:10,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:10,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:10,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:10,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:10,939 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:10,939 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:10,940 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:10,940 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,940 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:10,951 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,951 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,952 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:10,952 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,953 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:10,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,962 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:10,962 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:10,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:10,963 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:10,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:10,962 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:10,963 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:10,963 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:10,963 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:10,963 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,963 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:10,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:10,963 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,964 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,964 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:10,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:10,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:11,063 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:11,064 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:11,064 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:11,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:11,068 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:11,068 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:11,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:11,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:11,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,071 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:11,071 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:11,071 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:11,071 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:11,071 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,071 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,078 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:11,078 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:11,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:11,078 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:11,078 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,079 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,079 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,079 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:11,079 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,079 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:11,079 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:11,079 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:11,080 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:11,080 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:11,080 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:11,080 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:11,080 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:11,492 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010352e619236212483da10163b7c806f2dc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010352e619236212483da10163b7c806f2dc 2023-02-07 16:56:11,898 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/6fd90b943a044073aac7d00f91b7f5fc 2023-02-07 16:56:11,904 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/6fd90b943a044073aac7d00f91b7f5fc as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/6fd90b943a044073aac7d00f91b7f5fc 2023-02-07 16:56:11,908 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/6fd90b943a044073aac7d00f91b7f5fc, entries=1, sequenceid=33, filesize=4.9 K 2023-02-07 16:56:11,909 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 829ms, sequenceid=33, compaction requested=true 2023-02-07 16:56:11,909 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:11,910 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:11,910 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:11,910 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:11,910 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:11,910 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:11,910 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:11,958 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:11,958 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:11,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:11,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:11,959 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,959 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:11,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:11,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:11,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:11,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:11,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c53d0e0[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:11,963 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:11,963 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,010 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,011 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:12,011 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:12,011 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,012 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:12,012 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:12,084 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:12,084 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,084 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:12,085 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:12,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:12,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:12,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:12,096 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:12,096 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:12,096 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:12,097 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,097 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:12,157 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,157 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:12,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,158 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:12,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:12,158 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:12,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,159 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:12,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,232 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:12,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:12,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:12,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:12,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:12,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:12,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:12,233 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:12,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:12,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,233 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:12,233 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,234 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,234 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:12,333 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:12,334 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:12,334 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:12,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:12,338 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:12,338 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:12,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:12,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:12,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,341 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:12,341 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:12,341 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:12,341 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:12,341 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,341 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,363 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,363 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:12,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:12,363 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:12,363 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:12,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,364 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,364 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,364 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:12,364 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:12,364 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:12,364 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:12,364 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:12,365 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:12,365 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:12,365 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:12,365 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:12,365 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:12,785 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907e700a3c2ba1044f5b73d0c140f310929 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907e700a3c2ba1044f5b73d0c140f310929 2023-02-07 16:56:13,192 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/de279eb17ec74da4993c6fd6cf118096 2023-02-07 16:56:13,197 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/de279eb17ec74da4993c6fd6cf118096 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/de279eb17ec74da4993c6fd6cf118096 2023-02-07 16:56:13,202 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/de279eb17ec74da4993c6fd6cf118096, entries=1, sequenceid=37, filesize=4.9 K 2023-02-07 16:56:13,203 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 838ms, sequenceid=37, compaction requested=true 2023-02-07 16:56:13,203 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:13,203 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:13,203 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:13,203 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:13,203 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,203 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:13,203 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:13,336 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,336 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:13,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:13,337 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,337 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:13,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:13,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:13,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:13,339 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b14b6e2[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:13,339 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:13,339 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,358 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,358 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,358 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:13,358 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:13,358 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:13,358 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:13,368 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:13,368 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,368 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:13,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:13,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:13,369 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:13,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:13,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:13,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:13,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:13,371 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:13,371 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:13,371 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:13,371 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:13,371 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,371 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:13,383 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,383 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,383 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:13,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:13,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:13,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:13,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:13,384 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:13,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:13,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,385 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:13,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,393 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,393 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:13,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:13,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:13,393 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:13,393 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:13,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:13,393 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:13,394 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:13,394 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:13,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:13,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:13,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:13,394 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,394 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,394 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,394 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,394 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,494 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:13,494 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:13,494 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:13,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:13,499 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:13,499 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:13,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:13,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:13,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,501 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:13,501 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:13,501 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:13,501 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:13,501 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,502 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,509 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:13,509 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:13,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:13,510 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:13,510 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:13,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:13,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,510 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,510 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:13,510 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:13,510 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:13,511 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:13,511 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:13,511 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:13,511 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:13,511 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:13,511 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. started... 2023-02-07 16:56:13,511 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1eadc5198d8681736e2d7b473d06dfe0 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:13,924 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120919cefc4bb3f45808c3d9d5c3f89928b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120919cefc4bb3f45808c3d9d5c3f89928b 2023-02-07 16:56:14,335 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/3f98bcbe7cd44a68a194c4af3472d8a0 2023-02-07 16:56:14,342 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/3f98bcbe7cd44a68a194c4af3472d8a0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3f98bcbe7cd44a68a194c4af3472d8a0 2023-02-07 16:56:14,348 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3f98bcbe7cd44a68a194c4af3472d8a0, entries=1, sequenceid=41, filesize=4.9 K 2023-02-07 16:56:14,349 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1eadc5198d8681736e2d7b473d06dfe0 in 838ms, sequenceid=41, compaction requested=true 2023-02-07 16:56:14,349 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:14,349 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:14,349 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:14,349 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:14,349 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,349 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:14,350 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:14,368 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,368 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:14,369 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,369 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:14,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:14,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:14,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b2c9710[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:14,370 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:14,370 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,383 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,383 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,383 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:14,383 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:14,383 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:14,383 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,383 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:14,404 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,404 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:14,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:14,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:14,404 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:14,404 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:14,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:14,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:14,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:14,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:14,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:14,407 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:14,407 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:14,407 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:14,407 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,407 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:14,425 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,425 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,425 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:14,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:14,425 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,426 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,435 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:14,435 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:14,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-07 16:56:14,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:14,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:14,436 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:14,435 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,436 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,436 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:14,436 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:14,435 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:14,436 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:14,436 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:14,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:14,436 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:14,436 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,436 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,536 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:14,536 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:14,537 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:14,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:14,539 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-07 16:56:14,541 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:56:14,542 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:56:14,543 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:14,543 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789574543 2023-02-07 16:56:14,546 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-07 16:56:14,548 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-07 16:56:14,548 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:14,548 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x6969138a to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:56:14,563 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44e60488, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:56:14,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,416 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038b0adb7668104f529f0bd005d256fabe to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601038b0adb7668104f529f0bd005d256fabe 2023-02-07 16:56:15,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:15,431 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:56:15,432 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45422, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:56:15,438 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:15,438 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:15,439 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:56:15,440 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46262, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:56:15,450 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8aa51949db51446a8c4357d2421ae8b6 first=Optional[r3] last=Optional[r6] 2023-02-07 16:56:15,451 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8aa51949db51446a8c4357d2421ae8b6}] 2023-02-07 16:56:15,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8aa51949db51446a8c4357d2421ae8b6 for inclusion in 1eadc5198d8681736e2d7b473d06dfe0/family1 2023-02-07 16:56:15,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-07 16:56:15,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:15,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:15,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/8aa51949db51446a8c4357d2421ae8b6 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fqpjkt69n62pntl8v5mb73sqps9gm7fhqh5qel60o8u8gucjg535o56p1krf123r/family1/8aa51949db51446a8c4357d2421ae8b6 2023-02-07 16:56:15,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fqpjkt69n62pntl8v5mb73sqps9gm7fhqh5qel60o8u8gucjg535o56p1krf123r/family1/8aa51949db51446a8c4357d2421ae8b6 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/850861b2833340e6a9ff05c16d7cd543_SeqId_44_ 2023-02-07 16:56:15,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fqpjkt69n62pntl8v5mb73sqps9gm7fhqh5qel60o8u8gucjg535o56p1krf123r/family1/8aa51949db51446a8c4357d2421ae8b6 into 1eadc5198d8681736e2d7b473d06dfe0/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/850861b2833340e6a9ff05c16d7cd543_SeqId_44_ - updating store file list. 2023-02-07 16:56:15,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/850861b2833340e6a9ff05c16d7cd543_SeqId_44_ into 1eadc5198d8681736e2d7b473d06dfe0/family1 2023-02-07 16:56:15,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fqpjkt69n62pntl8v5mb73sqps9gm7fhqh5qel60o8u8gucjg535o56p1krf123r/family1/8aa51949db51446a8c4357d2421ae8b6 into 1eadc5198d8681736e2d7b473d06dfe0/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/850861b2833340e6a9ff05c16d7cd543_SeqId_44_) 2023-02-07 16:56:15,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__fqpjkt69n62pntl8v5mb73sqps9gm7fhqh5qel60o8u8gucjg535o56p1krf123r/family1/8aa51949db51446a8c4357d2421ae8b6 2023-02-07 16:56:15,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-07 16:56:15,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-07 16:56:15,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): 1eadc5198d8681736e2d7b473d06dfe0/family1 is initiating minor compaction 2023-02-07 16:56:15,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@9716dc; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:15,474 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 1eadc5198d8681736e2d7b473d06dfe0/family1 in testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:15,474 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/c5e25f7bc61943ec967390ac1678111d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/7f7fe805909d4e38adf0138bc436e036, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/04e5c67051a64c6389bb63254f84495e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/54f95390dca7425492b25e05f786b12f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/eeef7152edeb40db903d2d369c209fed, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3e61398f9e2c484781e6d6a251767aae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/6fd90b943a044073aac7d00f91b7f5fc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/de279eb17ec74da4993c6fd6cf118096, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3f98bcbe7cd44a68a194c4af3472d8a0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/850861b2833340e6a9ff05c16d7cd543_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp, totalSize=50.0 K 2023-02-07 16:56:15,474 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting c5e25f7bc61943ec967390ac1678111d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 7f7fe805909d4e38adf0138bc436e036, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 04e5c67051a64c6389bb63254f84495e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 54f95390dca7425492b25e05f786b12f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting eeef7152edeb40db903d2d369c209fed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 3e61398f9e2c484781e6d6a251767aae, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 6fd90b943a044073aac7d00f91b7f5fc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting de279eb17ec74da4993c6fd6cf118096, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 3f98bcbe7cd44a68a194c4af3472d8a0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-07 16:56:15,475 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 850861b2833340e6a9ff05c16d7cd543_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-07 16:56:15,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:15,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:15,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f98e48216cbe4b3e97f974519c955d5d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228f98e48216cbe4b3e97f974519c955d5d 2023-02-07 16:56:15,483 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1aefd0a2ea74d5d8b53024d2ee417c4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231c1aefd0a2ea74d5d8b53024d2ee417c4 2023-02-07 16:56:15,484 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019149d36968d94f86b24fe92def67d96a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601019149d36968d94f86b24fe92def67d96a 2023-02-07 16:56:15,485 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010352e619236212483da10163b7c806f2dc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010352e619236212483da10163b7c806f2dc 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-07 16:56:15,486 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,486 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:15,513 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1eadc5198d8681736e2d7b473d06dfe0#family1#compaction#34 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:56:15,932 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/4eb6d02bd98e4164908d7b102045d22e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/4eb6d02bd98e4164908d7b102045d22e 2023-02-07 16:56:15,938 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1eadc5198d8681736e2d7b473d06dfe0/family1 of 1eadc5198d8681736e2d7b473d06dfe0 into 4eb6d02bd98e4164908d7b102045d22e(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:56:15,938 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:15,938 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675788975474; duration=0sec 2023-02-07 16:56:15,938 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:15,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/c5e25f7bc61943ec967390ac1678111d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/7f7fe805909d4e38adf0138bc436e036, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/04e5c67051a64c6389bb63254f84495e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/54f95390dca7425492b25e05f786b12f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/eeef7152edeb40db903d2d369c209fed, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3e61398f9e2c484781e6d6a251767aae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/6fd90b943a044073aac7d00f91b7f5fc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/de279eb17ec74da4993c6fd6cf118096, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3f98bcbe7cd44a68a194c4af3472d8a0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/850861b2833340e6a9ff05c16d7cd543_SeqId_44_] to archive 2023-02-07 16:56:15,960 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:15,962 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/c5e25f7bc61943ec967390ac1678111d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/c5e25f7bc61943ec967390ac1678111d 2023-02-07 16:56:15,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/7f7fe805909d4e38adf0138bc436e036 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/7f7fe805909d4e38adf0138bc436e036 2023-02-07 16:56:15,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/04e5c67051a64c6389bb63254f84495e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/04e5c67051a64c6389bb63254f84495e 2023-02-07 16:56:15,967 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/54f95390dca7425492b25e05f786b12f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/54f95390dca7425492b25e05f786b12f 2023-02-07 16:56:15,969 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/eeef7152edeb40db903d2d369c209fed to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/eeef7152edeb40db903d2d369c209fed 2023-02-07 16:56:15,971 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3e61398f9e2c484781e6d6a251767aae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3e61398f9e2c484781e6d6a251767aae 2023-02-07 16:56:15,972 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/6fd90b943a044073aac7d00f91b7f5fc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/6fd90b943a044073aac7d00f91b7f5fc 2023-02-07 16:56:15,974 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/de279eb17ec74da4993c6fd6cf118096 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/de279eb17ec74da4993c6fd6cf118096 2023-02-07 16:56:15,975 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3f98bcbe7cd44a68a194c4af3472d8a0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/3f98bcbe7cd44a68a194c4af3472d8a0 2023-02-07 16:56:15,976 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/850861b2833340e6a9ff05c16d7cd543_SeqId_44_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/850861b2833340e6a9ff05c16d7cd543_SeqId_44_ 2023-02-07 16:56:16,338 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c13e975fc0a948e0a4d8cf59784725a0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205c13e975fc0a948e0a4d8cf59784725a0 2023-02-07 16:56:16,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:16,357 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:16,357 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:16,366 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/865d6a952bb84d42be3bf79a73ac131c first=Optional[r1] last=Optional[r2] 2023-02-07 16:56:16,366 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/865d6a952bb84d42be3bf79a73ac131c}] 2023-02-07 16:56:16,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/865d6a952bb84d42be3bf79a73ac131c for inclusion in 1eadc5198d8681736e2d7b473d06dfe0/family1 2023-02-07 16:56:16,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-07 16:56:16,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:16,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:16,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/865d6a952bb84d42be3bf79a73ac131c to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vqa8u19pve3s3heu711p0gbjdulmm75pv7vlui7ah7ajlkcppn5684uqbpnnkr9i/family1/865d6a952bb84d42be3bf79a73ac131c 2023-02-07 16:56:16,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vqa8u19pve3s3heu711p0gbjdulmm75pv7vlui7ah7ajlkcppn5684uqbpnnkr9i/family1/865d6a952bb84d42be3bf79a73ac131c as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_ 2023-02-07 16:56:16,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vqa8u19pve3s3heu711p0gbjdulmm75pv7vlui7ah7ajlkcppn5684uqbpnnkr9i/family1/865d6a952bb84d42be3bf79a73ac131c into 1eadc5198d8681736e2d7b473d06dfe0/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_ - updating store file list. 2023-02-07 16:56:16,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_ into 1eadc5198d8681736e2d7b473d06dfe0/family1 2023-02-07 16:56:16,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vqa8u19pve3s3heu711p0gbjdulmm75pv7vlui7ah7ajlkcppn5684uqbpnnkr9i/family1/865d6a952bb84d42be3bf79a73ac131c into 1eadc5198d8681736e2d7b473d06dfe0/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_) 2023-02-07 16:56:16,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithWeeklyPolicy__vqa8u19pve3s3heu711p0gbjdulmm75pv7vlui7ah7ajlkcppn5684uqbpnnkr9i/family1/865d6a952bb84d42be3bf79a73ac131c 2023-02-07 16:56:16,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-07 16:56:16,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-07 16:56:16,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): 1eadc5198d8681736e2d7b473d06dfe0/family1 is initiating minor compaction (all files) 2023-02-07 16:56:16,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d7ea3e7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:16,385 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 1eadc5198d8681736e2d7b473d06dfe0/family1 in testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:56:16,385 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/a6f0f1a76645475db149109694bd8f0f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/4eb6d02bd98e4164908d7b102045d22e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp, totalSize=176.8 K 2023-02-07 16:56:16,385 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting a6f0f1a76645475db149109694bd8f0f, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828694 2023-02-07 16:56:16,386 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 4eb6d02bd98e4164908d7b102045d22e, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228694 2023-02-07 16:56:16,386 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965228694 2023-02-07 16:56:16,387 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:16,387 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:16,389 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b635fa507947456f963fd04ba58fd445 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201b635fa507947456f963fd04ba58fd445 2023-02-07 16:56:16,390 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120522add548049d49c9af2235065d4574cb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120522add548049d49c9af2235065d4574cb 2023-02-07 16:56:16,390 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-07 16:56:16,390 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-07 16:56:16,390 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:16,390 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:16,391 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:16,391 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:56:16,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8510 sec 2023-02-07 16:56:16,404 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1eadc5198d8681736e2d7b473d06dfe0#family1#compaction#35 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:56:16,494 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=248 (was 252), OpenFileDescriptor=587 (was 605), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=271 (was 290), ProcessCount=171 (was 171), AvailableMemoryMB=3287 (was 2863) - AvailableMemoryMB LEAK? - 2023-02-07 16:56:16,504 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=248, OpenFileDescriptor=587, MaxFileDescriptor=60000, SystemLoadAverage=271, ProcessCount=171, AvailableMemoryMB=3287 2023-02-07 16:56:16,505 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:16,505 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:16,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-07 16:56:16,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:16,509 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:56:16,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-07 16:56:16,509 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:16,510 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:16,510 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:56:16,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-07 16:56:16,512 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:16,512 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:16,512 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:16,512 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa empty. 2023-02-07 16:56:16,512 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428 empty. 2023-02-07 16:56:16,512 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56 empty. 2023-02-07 16:56:16,513 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:16,513 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:16,513 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:16,513 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-07 16:56:16,610 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:16,611 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:16,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-07 16:56:16,812 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:16,813 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:16,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-07 16:56:16,924 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-07 16:56:16,926 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => 98768b553137c69d8bb07c1e6e0d62aa, NAME => 'testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:56:16,927 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => b8dbf0b15988f96ac5a80168a7d83428, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:56:16,928 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => c67e037707ba28847344ceb4cd827c56, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:56:17,115 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:17,115 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:17,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing b8dbf0b15988f96ac5a80168a7d83428, disabling compactions & flushes 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing 98768b553137c69d8bb07c1e6e0d62aa, disabling compactions & flushes 2023-02-07 16:56:17,338 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:17,338 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. after waiting 0 ms 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. after waiting 0 ms 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:17,338 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:17,338 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for b8dbf0b15988f96ac5a80168a7d83428: Waiting for close lock at 1675788977338Disabling compacts and flushes for region at 1675788977338Disabling writes for close at 1675788977338Writing region close event to WAL at 1675788977338Closed at 1675788977338 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for 98768b553137c69d8bb07c1e6e0d62aa: Waiting for close lock at 1675788977338Disabling compacts and flushes for region at 1675788977338Disabling writes for close at 1675788977338Writing region close event to WAL at 1675788977338Closed at 1675788977338 2023-02-07 16:56:17,338 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing c67e037707ba28847344ceb4cd827c56, disabling compactions & flushes 2023-02-07 16:56:17,339 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:17,339 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:17,339 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. after waiting 0 ms 2023-02-07 16:56:17,339 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:17,339 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:17,339 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for c67e037707ba28847344ceb4cd827c56: Waiting for close lock at 1675788977338Disabling compacts and flushes for region at 1675788977338Disabling writes for close at 1675788977339 (+1 ms)Writing region close event to WAL at 1675788977339Closed at 1675788977339 2023-02-07 16:56:17,342 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:56:17,343 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675788977342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788977342"}]},"ts":"1675788977342"} 2023-02-07 16:56:17,343 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675788977342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788977342"}]},"ts":"1675788977342"} 2023-02-07 16:56:17,343 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675788977342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788977342"}]},"ts":"1675788977342"} 2023-02-07 16:56:17,346 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-07 16:56:17,347 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:56:17,347 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788977347"}]},"ts":"1675788977347"} 2023-02-07 16:56:17,349 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-07 16:56:17,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=98768b553137c69d8bb07c1e6e0d62aa, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c67e037707ba28847344ceb4cd827c56, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b8dbf0b15988f96ac5a80168a7d83428, ASSIGN}] 2023-02-07 16:56:17,427 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b8dbf0b15988f96ac5a80168a7d83428, ASSIGN 2023-02-07 16:56:17,427 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c67e037707ba28847344ceb4cd827c56, ASSIGN 2023-02-07 16:56:17,428 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=98768b553137c69d8bb07c1e6e0d62aa, ASSIGN 2023-02-07 16:56:17,428 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c67e037707ba28847344ceb4cd827c56, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:56:17,428 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b8dbf0b15988f96ac5a80168a7d83428, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:56:17,428 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=98768b553137c69d8bb07c1e6e0d62aa, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:56:17,580 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c67e037707ba28847344ceb4cd827c56, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:17,580 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=98768b553137c69d8bb07c1e6e0d62aa, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:17,580 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=b8dbf0b15988f96ac5a80168a7d83428, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:17,581 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675788977580"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788977580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788977580"}]},"ts":"1675788977580"} 2023-02-07 16:56:17,581 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675788977580"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788977580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788977580"}]},"ts":"1675788977580"} 2023-02-07 16:56:17,581 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675788977580"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788977580"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788977580"}]},"ts":"1675788977580"} 2023-02-07 16:56:17,583 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure c67e037707ba28847344ceb4cd827c56, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:17,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=30, state=RUNNABLE; OpenRegionProcedure b8dbf0b15988f96ac5a80168a7d83428, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:17,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure 98768b553137c69d8bb07c1e6e0d62aa, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:17,617 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:17,617 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:17,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-07 16:56:17,626 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/.tmp/family1/512c16ef6d3a4ca59c3e18a5c6dd4a40 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/512c16ef6d3a4ca59c3e18a5c6dd4a40 2023-02-07 16:56:17,632 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1eadc5198d8681736e2d7b473d06dfe0/family1 of 1eadc5198d8681736e2d7b473d06dfe0 into 512c16ef6d3a4ca59c3e18a5c6dd4a40(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:56:17,632 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1eadc5198d8681736e2d7b473d06dfe0: 2023-02-07 16:56:17,632 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1675788976385; duration=1sec 2023-02-07 16:56:17,632 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:17,650 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/a6f0f1a76645475db149109694bd8f0f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/4eb6d02bd98e4164908d7b102045d22e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_] to archive 2023-02-07 16:56:17,651 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:17,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/a6f0f1a76645475db149109694bd8f0f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/a6f0f1a76645475db149109694bd8f0f 2023-02-07 16:56:17,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/4eb6d02bd98e4164908d7b102045d22e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/4eb6d02bd98e4164908d7b102045d22e 2023-02-07 16:56:17,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/family1/bf3a262624a14a1c9345df9178a0ef1c_SeqId_47_ 2023-02-07 16:56:17,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:17,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b8dbf0b15988f96ac5a80168a7d83428, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428.', STARTKEY => '2', ENDKEY => ''} 2023-02-07 16:56:17,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:17,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:17,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:17,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:17,747 INFO [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:17,751 DEBUG [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1 2023-02-07 16:56:17,751 DEBUG [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1 2023-02-07 16:56:17,751 INFO [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8dbf0b15988f96ac5a80168a7d83428 columnFamilyName family1 2023-02-07 16:56:17,753 INFO [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] regionserver.HStore(310): Store=b8dbf0b15988f96ac5a80168a7d83428/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:17,754 INFO [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:17,755 DEBUG [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family2 2023-02-07 16:56:17,755 DEBUG [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family2 2023-02-07 16:56:17,755 INFO [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b8dbf0b15988f96ac5a80168a7d83428 columnFamilyName family2 2023-02-07 16:56:17,756 INFO [StoreOpener-b8dbf0b15988f96ac5a80168a7d83428-1] regionserver.HStore(310): Store=b8dbf0b15988f96ac5a80168a7d83428/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:17,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:17,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:17,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:56:17,760 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:56:17,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:56:17,762 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened b8dbf0b15988f96ac5a80168a7d83428; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58996784, jitterRate=-0.1208794116973877}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:56:17,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for b8dbf0b15988f96ac5a80168a7d83428: Running coprocessor pre-open hook at 1675788977744Writing region info on filesystem at 1675788977744Initializing all the Stores at 1675788977747 (+3 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675788977747Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675788977747Cleaning up temporary data from old regions at 1675788977758 (+11 ms)Cleaning up detritus from prior splits at 1675788977758Running coprocessor post-open hooks at 1675788977762 (+4 ms)Region opened successfully at 1675788977762 2023-02-07 16:56:17,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428., pid=32, masterSystemTime=1675788977735 2023-02-07 16:56:17,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:17,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:17,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:17,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => c67e037707ba28847344ceb4cd827c56, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56.', STARTKEY => '1', ENDKEY => '2'} 2023-02-07 16:56:17,766 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=b8dbf0b15988f96ac5a80168a7d83428, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:17,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:17,766 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675788977765"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788977765"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788977765"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788977765"}]},"ts":"1675788977765"} 2023-02-07 16:56:17,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:17,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:17,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:17,768 INFO [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:17,770 DEBUG [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56/family1 2023-02-07 16:56:17,770 DEBUG [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56/family1 2023-02-07 16:56:17,770 INFO [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c67e037707ba28847344ceb4cd827c56 columnFamilyName family1 2023-02-07 16:56:17,771 INFO [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] regionserver.HStore(310): Store=c67e037707ba28847344ceb4cd827c56/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:17,772 INFO [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:17,773 DEBUG [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56/family2 2023-02-07 16:56:17,774 DEBUG [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56/family2 2023-02-07 16:56:17,774 INFO [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c67e037707ba28847344ceb4cd827c56 columnFamilyName family2 2023-02-07 16:56:17,775 INFO [StoreOpener-c67e037707ba28847344ceb4cd827c56-1] regionserver.HStore(310): Store=c67e037707ba28847344ceb4cd827c56/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:17,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:17,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:17,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=30 2023-02-07 16:56:17,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=30, state=SUCCESS; OpenRegionProcedure b8dbf0b15988f96ac5a80168a7d83428, server=jenkins-hbase12.apache.org,33237,1675788923983 in 191 msec 2023-02-07 16:56:17,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:56:17,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b8dbf0b15988f96ac5a80168a7d83428, ASSIGN in 353 msec 2023-02-07 16:56:17,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for c67e037707ba28847344ceb4cd827c56 2023-02-07 16:56:17,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:56:17,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened c67e037707ba28847344ceb4cd827c56; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72307997, jitterRate=0.07747311890125275}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:56:17,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for c67e037707ba28847344ceb4cd827c56: Running coprocessor pre-open hook at 1675788977766Writing region info on filesystem at 1675788977766Initializing all the Stores at 1675788977767 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675788977767Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675788977768 (+1 ms)Cleaning up temporary data from old regions at 1675788977778 (+10 ms)Cleaning up detritus from prior splits at 1675788977778Running coprocessor post-open hooks at 1675788977783 (+5 ms)Region opened successfully at 1675788977783 2023-02-07 16:56:17,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56., pid=31, masterSystemTime=1675788977735 2023-02-07 16:56:17,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:17,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:17,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:17,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 98768b553137c69d8bb07c1e6e0d62aa, NAME => 'testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa.', STARTKEY => '', ENDKEY => '1'} 2023-02-07 16:56:17,786 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c67e037707ba28847344ceb4cd827c56, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:17,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:17,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:17,786 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675788977786"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788977786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788977786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788977786"}]},"ts":"1675788977786"} 2023-02-07 16:56:17,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:17,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:17,788 INFO [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:17,789 DEBUG [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa/family1 2023-02-07 16:56:17,789 DEBUG [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa/family1 2023-02-07 16:56:17,790 INFO [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98768b553137c69d8bb07c1e6e0d62aa columnFamilyName family1 2023-02-07 16:56:17,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-02-07 16:56:17,790 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure c67e037707ba28847344ceb4cd827c56, server=jenkins-hbase12.apache.org,33237,1675788923983 in 205 msec 2023-02-07 16:56:17,791 INFO [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] regionserver.HStore(310): Store=98768b553137c69d8bb07c1e6e0d62aa/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:17,791 INFO [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:17,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=c67e037707ba28847344ceb4cd827c56, ASSIGN in 365 msec 2023-02-07 16:56:17,792 DEBUG [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa/family2 2023-02-07 16:56:17,793 DEBUG [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa/family2 2023-02-07 16:56:17,793 INFO [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 98768b553137c69d8bb07c1e6e0d62aa columnFamilyName family2 2023-02-07 16:56:17,794 INFO [StoreOpener-98768b553137c69d8bb07c1e6e0d62aa-1] regionserver.HStore(310): Store=98768b553137c69d8bb07c1e6e0d62aa/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:17,794 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:17,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:17,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:56:17,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:56:17,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:56:17,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 98768b553137c69d8bb07c1e6e0d62aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59940527, jitterRate=-0.10681654512882233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:56:17,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 98768b553137c69d8bb07c1e6e0d62aa: Running coprocessor pre-open hook at 1675788977787Writing region info on filesystem at 1675788977787Initializing all the Stores at 1675788977788 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675788977788Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675788977788Cleaning up temporary data from old regions at 1675788977796 (+8 ms)Cleaning up detritus from prior splits at 1675788977796Running coprocessor post-open hooks at 1675788977800 (+4 ms)Region opened successfully at 1675788977800 2023-02-07 16:56:17,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa., pid=33, masterSystemTime=1675788977735 2023-02-07 16:56:17,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:17,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:17,803 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=98768b553137c69d8bb07c1e6e0d62aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:17,803 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675788977803"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788977803"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788977803"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788977803"}]},"ts":"1675788977803"} 2023-02-07 16:56:17,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-02-07 16:56:17,806 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure 98768b553137c69d8bb07c1e6e0d62aa, server=jenkins-hbase12.apache.org,33237,1675788923983 in 219 msec 2023-02-07 16:56:17,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-02-07 16:56:17,808 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=98768b553137c69d8bb07c1e6e0d62aa, ASSIGN in 381 msec 2023-02-07 16:56:17,809 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:56:17,809 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788977809"}]},"ts":"1675788977809"} 2023-02-07 16:56:17,810 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-07 16:56:17,821 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:56:17,823 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.3160 sec 2023-02-07 16:56:18,618 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:18,618 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:18,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-07 16:56:18,620 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-07 16:56:18,628 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:18,628 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:18,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:18,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:18,631 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-07 16:56:18,631 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:18,631 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-07 16:56:18,631 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-07 16:56:18,632 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:18,632 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:18,677 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:18,677 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:18,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:18,678 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:18,678 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:18,678 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:18,678 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:18,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:18,679 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-07 16:56:18,679 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:18,679 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-07 16:56:18,679 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:18,679 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. started... 2023-02-07 16:56:18,679 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:56:18,679 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:18,679 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:18,679 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:18,680 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. started... 2023-02-07 16:56:18,680 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c67e037707ba28847344ceb4cd827c56: 2023-02-07 16:56:18,680 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. started... 2023-02-07 16:56:18,680 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 98768b553137c69d8bb07c1e6e0d62aa: 2023-02-07 16:56:18,680 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:18,680 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b8dbf0b15988f96ac5a80168a7d83428 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-07 16:56:18,680 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:18,680 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:56:18,680 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:56:19,096 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207da28b07b842b4719b5d0272f32e8e490 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230207da28b07b842b4719b5d0272f32e8e490 2023-02-07 16:56:19,504 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/.tmp/family1/c1ede4d7cc1c497895edff19f1164ab0 2023-02-07 16:56:19,509 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/.tmp/family1/c1ede4d7cc1c497895edff19f1164ab0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/c1ede4d7cc1c497895edff19f1164ab0 2023-02-07 16:56:19,514 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/c1ede4d7cc1c497895edff19f1164ab0, entries=1, sequenceid=5, filesize=4.9 K 2023-02-07 16:56:19,515 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for b8dbf0b15988f96ac5a80168a7d83428 in 835ms, sequenceid=5, compaction requested=false 2023-02-07 16:56:19,515 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-07 16:56:19,515 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b8dbf0b15988f96ac5a80168a7d83428: 2023-02-07 16:56:19,515 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:19,515 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:56:19,515 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:56:19,515 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,515 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-07 16:56:19,516 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-07 16:56:19,578 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,578 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:19,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:19,579 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,579 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:19,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:19,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:19,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-07 16:56:19,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cc10260[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:19,583 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-07 16:56:19,583 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,642 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-07 16:56:19,642 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,642 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:19,642 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-07 16:56:19,642 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:19,663 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-07 16:56:19,663 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,663 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:19,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:19,663 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-07 16:56:19,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:19,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:19,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:19,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:19,666 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-07 16:56:19,666 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-07 16:56:19,666 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:19,666 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:19,666 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,666 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:19,677 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,677 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:19,677 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:19,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:19,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,678 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,679 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,716 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:19,716 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,716 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:19,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-07 16:56:19,716 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:19,716 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:19,716 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:19,717 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-07 16:56:19,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:19,716 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,717 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:19,717 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,717 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:19,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:19,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:19,717 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,717 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,717 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,817 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:19,817 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:19,817 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:19,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:19,823 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:19,823 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:19,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:19,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:19,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,826 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-07 16:56:19,826 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:19,827 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-07 16:56:19,827 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-07 16:56:19,827 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,827 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,846 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,846 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:19,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:19,846 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:19,846 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:19,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,847 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:19,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,848 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,848 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-07 16:56:19,848 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:19,848 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-07 16:56:19,848 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:19,848 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. started... 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for c67e037707ba28847344ceb4cd827c56: 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. started... 2023-02-07 16:56:19,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 98768b553137c69d8bb07c1e6e0d62aa: 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:56:19,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:19,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. started... 2023-02-07 16:56:19,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:56:19,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:56:19,850 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b8dbf0b15988f96ac5a80168a7d83428 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-07 16:56:20,265 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207483961480c224353b74e2753a783b325 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230207483961480c224353b74e2753a783b325 2023-02-07 16:56:20,674 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/.tmp/family1/ec4bc3461aef428b9436ac44b8a7c2b1 2023-02-07 16:56:20,685 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/.tmp/family1/ec4bc3461aef428b9436ac44b8a7c2b1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/ec4bc3461aef428b9436ac44b8a7c2b1 2023-02-07 16:56:20,689 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/ec4bc3461aef428b9436ac44b8a7c2b1, entries=2, sequenceid=9, filesize=5.0 K 2023-02-07 16:56:20,690 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for b8dbf0b15988f96ac5a80168a7d83428 in 840ms, sequenceid=9, compaction requested=false 2023-02-07 16:56:20,691 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b8dbf0b15988f96ac5a80168a7d83428: 2023-02-07 16:56:20,691 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:20,691 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:56:20,691 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:56:20,691 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,691 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-07 16:56:20,691 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-07 16:56:20,698 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,698 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:20,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:20,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:20,699 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:20,699 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:20,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:20,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-07 16:56:20,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e770dc8[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:20,700 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-07 16:56:20,700 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,709 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:20,709 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-07 16:56:20,709 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-07 16:56:20,709 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:20,719 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-07 16:56:20,719 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:20,719 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,719 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-07 16:56:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:20,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:20,722 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-07 16:56:20,722 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-07 16:56:20,722 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:20,722 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:20,722 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,722 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:20,740 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,740 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:20,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:20,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,740 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:20,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:20,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:20,741 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:20,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,742 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:20,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,761 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,761 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:20,762 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:20,761 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,762 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:20,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-07 16:56:20,762 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:20,762 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,762 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:20,762 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,762 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:20,762 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:20,763 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:20,762 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:20,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:20,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:20,863 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:20,863 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:20,863 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:20,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:20,877 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-07 16:56:20,879 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-07 16:56:20,880 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-07 16:56:20,881 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:20,881 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789580881 2023-02-07 16:56:20,881 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:56:20,882 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-07 16:56:20,882 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-07 16:56:20,882 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x1315131c to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:56:20,916 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67a397b2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:56:20,917 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230207 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-07 16:56:21,756 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207732c541d93c4459e9fa6e1172b842ea7 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230207732c541d93c4459e9fa6e1172b842ea7 2023-02-07 16:56:21,758 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-07 16:56:21,771 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:56:21,772 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45438, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:56:21,779 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:21,779 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:21,779 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:56:21,781 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46264, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:56:21,790 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230207/family1/649ecd9e7a324cd0ad611194f76dc522 first=Optional[k0] last=Optional[k1] 2023-02-07 16:56:21,791 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230207/family1/649ecd9e7a324cd0ad611194f76dc522}] 2023-02-07 16:56:21,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230207/family1/649ecd9e7a324cd0ad611194f76dc522 for inclusion in b8dbf0b15988f96ac5a80168a7d83428/family1 2023-02-07 16:56:21,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-07 16:56:21,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-07 16:56:21,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for b8dbf0b15988f96ac5a80168a7d83428: 2023-02-07 16:56:21,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230207/family1/649ecd9e7a324cd0ad611194f76dc522 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testScannerOnBulkLoadRefHFiles__9jvuc5v902a854tmjfsb42tj5eh1h49ng0bhfibelk1uu058iu7j9218ib0md1sb/family1/649ecd9e7a324cd0ad611194f76dc522 2023-02-07 16:56:21,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testScannerOnBulkLoadRefHFiles__9jvuc5v902a854tmjfsb42tj5eh1h49ng0bhfibelk1uu058iu7j9218ib0md1sb/family1/649ecd9e7a324cd0ad611194f76dc522 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_ 2023-02-07 16:56:21,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testScannerOnBulkLoadRefHFiles__9jvuc5v902a854tmjfsb42tj5eh1h49ng0bhfibelk1uu058iu7j9218ib0md1sb/family1/649ecd9e7a324cd0ad611194f76dc522 into b8dbf0b15988f96ac5a80168a7d83428/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_ - updating store file list. 2023-02-07 16:56:21,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_ into b8dbf0b15988f96ac5a80168a7d83428/family1 2023-02-07 16:56:21,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testScannerOnBulkLoadRefHFiles__9jvuc5v902a854tmjfsb42tj5eh1h49ng0bhfibelk1uu058iu7j9218ib0md1sb/family1/649ecd9e7a324cd0ad611194f76dc522 into b8dbf0b15988f96ac5a80168a7d83428/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_) 2023-02-07 16:56:21,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testScannerOnBulkLoadRefHFiles__9jvuc5v902a854tmjfsb42tj5eh1h49ng0bhfibelk1uu058iu7j9218ib0md1sb/family1/649ecd9e7a324cd0ad611194f76dc522 2023-02-07 16:56:21,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-07 16:56:21,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-07 16:56:21,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): b8dbf0b15988f96ac5a80168a7d83428/family1 is initiating minor compaction (all files) 2023-02-07 16:56:21,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2cac3e0a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:21,807 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of b8dbf0b15988f96ac5a80168a7d83428/family1 in testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:56:21,807 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/c1ede4d7cc1c497895edff19f1164ab0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/ec4bc3461aef428b9436ac44b8a7c2b1, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/.tmp, totalSize=15.1 K 2023-02-07 16:56:21,808 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting c1ede4d7cc1c497895edff19f1164ab0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675788978621 2023-02-07 16:56:21,809 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting ec4bc3461aef428b9436ac44b8a7c2b1, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675788978621 2023-02-07 16:56:21,809 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675788978621 2023-02-07 16:56:21,809 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-07 16:56:21,810 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:21,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230207483961480c224353b74e2753a783b325 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230207483961480c224353b74e2753a783b325 2023-02-07 16:56:21,813 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230207da28b07b842b4719b5d0272f32e8e490 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20230207da28b07b842b4719b5d0272f32e8e490 2023-02-07 16:56:21,813 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-07 16:56:21,813 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230207' 2023-02-07 16:56:21,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230207 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-07 16:56:21,814 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-07 16:56:21,814 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:21,815 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-07 16:56:21,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 937 msec 2023-02-07 16:56:21,820 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): b8dbf0b15988f96ac5a80168a7d83428#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:56:21,856 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=244 (was 248), OpenFileDescriptor=590 (was 587) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=257 (was 271), ProcessCount=172 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=3174 (was 3287) 2023-02-07 16:56:21,869 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=242, OpenFileDescriptor=590, MaxFileDescriptor=60000, SystemLoadAverage=257, ProcessCount=172, AvailableMemoryMB=3174 2023-02-07 16:56:21,869 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:21,869 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:21,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-07 16:56:21,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:21,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:56:21,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-07 16:56:21,873 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:21,874 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:21,874 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:56:21,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-07 16:56:21,875 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:21,876 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b empty. 2023-02-07 16:56:21,876 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:21,876 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-07 16:56:21,975 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:21,975 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:21,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-07 16:56:22,177 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:22,177 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:22,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-07 16:56:22,287 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-07 16:56:22,290 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => a4c0a29d4ff41edc8f2623eb67694c5b, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:56:22,478 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:22,479 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:22,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-07 16:56:22,700 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:22,701 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing a4c0a29d4ff41edc8f2623eb67694c5b, disabling compactions & flushes 2023-02-07 16:56:22,701 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:22,701 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:22,701 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. after waiting 0 ms 2023-02-07 16:56:22,701 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:22,701 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:22,701 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for a4c0a29d4ff41edc8f2623eb67694c5b: Waiting for close lock at 1675788982701Disabling compacts and flushes for region at 1675788982701Disabling writes for close at 1675788982701Writing region close event to WAL at 1675788982701Closed at 1675788982701 2023-02-07 16:56:22,704 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:56:22,706 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675788982706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788982706"}]},"ts":"1675788982706"} 2023-02-07 16:56:22,708 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:56:22,709 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:56:22,709 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788982709"}]},"ts":"1675788982709"} 2023-02-07 16:56:22,711 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-07 16:56:22,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=a4c0a29d4ff41edc8f2623eb67694c5b, ASSIGN}] 2023-02-07 16:56:22,743 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=a4c0a29d4ff41edc8f2623eb67694c5b, ASSIGN 2023-02-07 16:56:22,744 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=a4c0a29d4ff41edc8f2623eb67694c5b, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:56:22,895 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a4c0a29d4ff41edc8f2623eb67694c5b, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:22,895 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675788982895"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788982895"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788982895"}]},"ts":"1675788982895"} 2023-02-07 16:56:22,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure a4c0a29d4ff41edc8f2623eb67694c5b, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:22,981 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:22,981 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:22,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-07 16:56:23,045 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/.tmp/family1/444722fdeacd4769808bb3b78eba1648 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/444722fdeacd4769808bb3b78eba1648 2023-02-07 16:56:23,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:23,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a4c0a29d4ff41edc8f2623eb67694c5b, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:56:23,052 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b8dbf0b15988f96ac5a80168a7d83428/family1 of b8dbf0b15988f96ac5a80168a7d83428 into 444722fdeacd4769808bb3b78eba1648(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:56:23,052 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for b8dbf0b15988f96ac5a80168a7d83428: 2023-02-07 16:56:23,053 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1675788981807; duration=1sec 2023-02-07 16:56:23,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:23,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:23,053 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:23,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:23,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:23,054 INFO [StoreOpener-a4c0a29d4ff41edc8f2623eb67694c5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:23,055 DEBUG [StoreOpener-a4c0a29d4ff41edc8f2623eb67694c5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1 2023-02-07 16:56:23,056 DEBUG [StoreOpener-a4c0a29d4ff41edc8f2623eb67694c5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1 2023-02-07 16:56:23,056 INFO [StoreOpener-a4c0a29d4ff41edc8f2623eb67694c5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4c0a29d4ff41edc8f2623eb67694c5b columnFamilyName family1 2023-02-07 16:56:23,057 INFO [StoreOpener-a4c0a29d4ff41edc8f2623eb67694c5b-1] regionserver.HStore(310): Store=a4c0a29d4ff41edc8f2623eb67694c5b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:23,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:23,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:23,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:56:23,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:56:23,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened a4c0a29d4ff41edc8f2623eb67694c5b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69744052, jitterRate=0.03926736116409302}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:56:23,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for a4c0a29d4ff41edc8f2623eb67694c5b: Running coprocessor pre-open hook at 1675788983053Writing region info on filesystem at 1675788983053Initializing all the Stores at 1675788983054 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675788983054Cleaning up temporary data from old regions at 1675788983059 (+5 ms)Cleaning up detritus from prior splits at 1675788983059Running coprocessor post-open hooks at 1675788983063 (+4 ms)Region opened successfully at 1675788983063 2023-02-07 16:56:23,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b., pid=37, masterSystemTime=1675788983050 2023-02-07 16:56:23,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:23,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:23,066 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a4c0a29d4ff41edc8f2623eb67694c5b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:23,066 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675788983066"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788983066"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788983066"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788983066"}]},"ts":"1675788983066"} 2023-02-07 16:56:23,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-07 16:56:23,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure a4c0a29d4ff41edc8f2623eb67694c5b, server=jenkins-hbase12.apache.org,33237,1675788923983 in 171 msec 2023-02-07 16:56:23,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-07 16:56:23,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=a4c0a29d4ff41edc8f2623eb67694c5b, ASSIGN in 329 msec 2023-02-07 16:56:23,072 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:56:23,072 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788983072"}]},"ts":"1675788983072"} 2023-02-07 16:56:23,073 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-07 16:56:23,084 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:56:23,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.2130 sec 2023-02-07 16:56:23,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/c1ede4d7cc1c497895edff19f1164ab0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/ec4bc3461aef428b9436ac44b8a7c2b1, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_] to archive 2023-02-07 16:56:23,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:23,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/c1ede4d7cc1c497895edff19f1164ab0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/c1ede4d7cc1c497895edff19f1164ab0 2023-02-07 16:56:23,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/ec4bc3461aef428b9436ac44b8a7c2b1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/ec4bc3461aef428b9436ac44b8a7c2b1 2023-02-07 16:56:23,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/family1/6ce9c6b3ea264554953a5ebb672eb4a2_SeqId_12_ 2023-02-07 16:56:23,276 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:56:23,982 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:23,982 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:23,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-07 16:56:23,984 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-07 16:56:24,005 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:24,006 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:24,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:24,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,007 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:24,008 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:24,008 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:24,008 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:24,008 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,008 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,020 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:24,020 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:24,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:24,021 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,021 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,021 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:24,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,021 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,022 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:24,022 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:24,022 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:24,022 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:24,022 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:24,022 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:24,022 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:24,023 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-07 16:56:24,448 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130f42928e51a8b4f5694c8af4353a2f9f0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f42928e51a8b4f5694c8af4353a2f9f0 2023-02-07 16:56:24,855 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/982e92eed91947db85d90df7b771dc11 2023-02-07 16:56:24,863 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/982e92eed91947db85d90df7b771dc11 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/982e92eed91947db85d90df7b771dc11 2023-02-07 16:56:24,868 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/982e92eed91947db85d90df7b771dc11, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-07 16:56:24,868 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 845ms, sequenceid=5, compaction requested=false 2023-02-07 16:56:24,869 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:24,869 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:24,869 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:24,869 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:24,869 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:24,869 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,869 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:24,869 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:24,887 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,887 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:24,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:24,888 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,888 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:24,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:24,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:24,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20ca0f42[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:24,890 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:24,890 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,908 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,909 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:24,909 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:24,909 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:24,909 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,909 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:24,919 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:24,919 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,919 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:24,919 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:24,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:24,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:24,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:24,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:24,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:24,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:24,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:24,922 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:24,922 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:24,922 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:24,922 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,922 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:24,940 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,940 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,940 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:24,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,941 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:24,941 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:24,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:24,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:24,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,942 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:24,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,961 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,961 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,961 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,962 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:24,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:24,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:24,961 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:24,962 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:24,962 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:24,962 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:24,962 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:24,963 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:24,962 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,962 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:24,963 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:24,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:24,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:25,063 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:25,063 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:25,063 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:25,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:25,069 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:25,069 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:25,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:25,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:25,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,072 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:25,072 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:25,072 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:25,072 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:25,073 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,073 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,083 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:25,083 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:25,084 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,084 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:25,084 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,084 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,085 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:25,085 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,085 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:25,085 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:25,085 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:25,085 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:25,085 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:25,085 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:25,085 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:25,085 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-07 16:56:25,505 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128accc6b138bc9475aa2b031eff93eab2f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128accc6b138bc9475aa2b031eff93eab2f 2023-02-07 16:56:25,516 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/ef62b0e16af94c729644feb265a75184 2023-02-07 16:56:25,520 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/ef62b0e16af94c729644feb265a75184 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/ef62b0e16af94c729644feb265a75184 2023-02-07 16:56:25,524 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/ef62b0e16af94c729644feb265a75184, entries=1, sequenceid=9, filesize=5.0 K 2023-02-07 16:56:25,525 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 440ms, sequenceid=9, compaction requested=false 2023-02-07 16:56:25,525 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:25,525 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:25,525 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:25,525 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:25,525 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,525 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:25,525 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:25,582 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,582 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:25,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:25,619 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,620 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:25,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:25,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:25,724 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f31885c[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:25,724 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:25,724 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,747 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-07 16:56:25,789 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,790 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:25,790 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:25,790 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,790 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:25,790 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:25,868 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,868 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:25,868 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:25,868 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:25,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:25,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:25,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:25,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:25,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:25,874 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:25,874 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:25,874 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:25,874 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,874 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:25,898 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,898 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:25,898 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:25,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:25,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:25,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:25,900 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:25,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,902 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,915 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,915 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,915 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,915 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:25,915 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:25,915 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:25,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:25,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:25,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:25,915 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,916 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,916 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:25,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:25,916 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:25,915 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:25,916 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:25,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:26,016 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:26,016 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:26,016 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:26,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:26,021 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:26,021 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:26,022 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:26,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:26,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,024 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:26,024 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:26,024 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:26,024 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:26,025 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,025 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,035 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,035 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:26,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:26,035 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,035 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,036 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,036 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:26,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,036 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:26,036 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:26,036 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:26,037 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:26,037 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:26,037 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:26,037 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:26,037 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:26,455 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201bc5402553d684c57aa02ca4a09662692 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc5402553d684c57aa02ca4a09662692 2023-02-07 16:56:26,866 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/6b8df2977b384fe29fa869a988aeb2c2 2023-02-07 16:56:26,878 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/6b8df2977b384fe29fa869a988aeb2c2 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6b8df2977b384fe29fa869a988aeb2c2 2023-02-07 16:56:26,886 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6b8df2977b384fe29fa869a988aeb2c2, entries=1, sequenceid=13, filesize=4.9 K 2023-02-07 16:56:26,888 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 851ms, sequenceid=13, compaction requested=true 2023-02-07 16:56:26,889 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:26,889 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:26,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:26,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:26,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:26,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:26,905 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,905 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:26,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:26,905 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,905 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:26,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:26,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:26,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:26,909 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1bb751d8[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:26,909 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:26,910 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,919 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,919 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:26,920 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:26,920 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:26,920 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,920 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:26,929 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,929 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:26,929 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:26,929 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:26,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:26,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:26,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:26,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:26,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:26,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:26,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:26,932 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:26,932 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:26,932 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:26,932 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,932 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:26,940 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,940 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,940 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:26,940 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:26,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,941 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:26,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,950 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:26,950 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:26,950 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:26,950 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:26,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:26,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:26,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:26,950 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,951 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,951 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:26,951 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:26,951 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:26,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:26,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:26,951 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:26,951 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:26,951 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,051 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:27,051 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:27,052 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:27,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:27,061 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:27,061 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:27,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:27,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:27,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,064 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:27,064 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:27,064 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:27,064 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:27,064 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,064 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,076 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:27,076 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:27,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:27,077 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:27,077 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:27,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:27,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:27,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:27,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:27,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:27,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:27,078 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:27,078 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:27,079 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:27,495 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205b6dc100efc1b4c1d9dbb7711d0a13c90 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b6dc100efc1b4c1d9dbb7711d0a13c90 2023-02-07 16:56:27,902 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/944cd63e7d3542e9beb1500b297f406d 2023-02-07 16:56:27,907 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/944cd63e7d3542e9beb1500b297f406d as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/944cd63e7d3542e9beb1500b297f406d 2023-02-07 16:56:27,912 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/944cd63e7d3542e9beb1500b297f406d, entries=1, sequenceid=17, filesize=4.9 K 2023-02-07 16:56:27,913 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 834ms, sequenceid=17, compaction requested=true 2023-02-07 16:56:27,913 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:27,913 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:27,913 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:27,913 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:27,913 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:27,913 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:27,913 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:27,982 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:27,982 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:27,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:27,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:27,983 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,983 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:27,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:27,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:27,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:27,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:27,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:27,988 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d28062b[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:27,988 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:27,988 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,999 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:27,999 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:27,999 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:27,999 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:27,999 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,000 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:28,010 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:28,010 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,010 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:28,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:28,010 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:28,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:28,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:28,014 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:28,014 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:28,014 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:28,014 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,014 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:28,024 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,024 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:28,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,024 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:28,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:28,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:28,024 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,025 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,034 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,034 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:28,034 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:28,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:28,034 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:28,034 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:28,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:28,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:28,034 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:28,034 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:28,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:28,035 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,035 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,035 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:28,035 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:28,035 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,035 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,135 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:28,135 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:28,136 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:28,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:28,146 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:28,146 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:28,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:28,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:28,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,151 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:28,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:28,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:28,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:28,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,152 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,189 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:28,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:28,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:28,190 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:28,190 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:28,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:28,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,193 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,193 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:28,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:28,193 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:28,193 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:28,193 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:28,194 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:28,194 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:28,194 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:28,194 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:28,194 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:28,554 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:56:28,611 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228cb339358840047deb09063c9d3700ecd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228cb339358840047deb09063c9d3700ecd 2023-02-07 16:56:29,017 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/268f1c044a1b4f798c89f08fe658daee 2023-02-07 16:56:29,023 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/268f1c044a1b4f798c89f08fe658daee as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/268f1c044a1b4f798c89f08fe658daee 2023-02-07 16:56:29,028 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/268f1c044a1b4f798c89f08fe658daee, entries=1, sequenceid=21, filesize=4.9 K 2023-02-07 16:56:29,029 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 835ms, sequenceid=21, compaction requested=true 2023-02-07 16:56:29,029 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:29,029 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:29,029 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:29,029 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:29,030 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,030 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:29,030 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:29,076 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,077 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:29,077 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,077 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:29,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:29,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:29,078 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:29,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6de8bad3[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:29,078 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,087 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,087 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:29,087 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:29,087 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:29,087 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,087 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:29,097 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,097 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:29,098 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:29,098 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:29,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:29,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:29,100 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:29,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:29,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:29,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,100 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:29,108 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,108 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,108 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:29,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:29,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,108 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:29,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,110 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:29,119 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:29,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:29,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:29,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,119 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:29,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:29,119 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:29,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:29,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:29,220 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:29,220 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:29,220 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:29,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:29,225 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:29,225 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:29,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:29,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:29,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,228 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:29,228 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:29,228 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:29,228 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:29,228 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,228 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,234 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:29,234 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:29,235 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:29,235 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:29,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,235 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,236 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:29,236 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:29,236 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:29,236 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:29,236 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:29,236 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:29,236 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:29,236 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:29,236 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:29,236 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:29,651 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123143598f59061d4a2b80281c3228e8e159 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123143598f59061d4a2b80281c3228e8e159 2023-02-07 16:56:30,059 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/171f52ad439e42e2b4c13e3e334f75cb 2023-02-07 16:56:30,069 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/171f52ad439e42e2b4c13e3e334f75cb as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/171f52ad439e42e2b4c13e3e334f75cb 2023-02-07 16:56:30,077 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/171f52ad439e42e2b4c13e3e334f75cb, entries=1, sequenceid=25, filesize=4.9 K 2023-02-07 16:56:30,078 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 842ms, sequenceid=25, compaction requested=true 2023-02-07 16:56:30,078 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:30,078 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:30,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:30,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:30,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:30,078 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:30,129 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,129 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:30,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:30,131 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,131 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:30,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:30,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:30,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:30,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:30,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e58bc5a[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:30,137 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:30,137 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,150 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,151 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:30,151 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:30,151 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:30,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:30,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:30,160 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,161 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:30,161 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:30,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:30,163 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:30,163 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:30,163 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:30,163 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,163 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:30,171 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,171 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:30,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:30,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,171 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:30,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,173 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:30,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:30,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:30,173 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:30,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,175 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,188 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:30,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:30,188 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,189 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:30,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:30,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:30,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:30,189 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:30,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:30,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:30,290 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:30,290 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:30,290 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:30,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:30,294 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:30,294 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:30,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:30,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:30,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,297 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:30,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:30,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:30,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:30,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,298 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,308 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,308 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:30,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:30,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:30,308 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:30,308 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:30,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:30,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,309 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,309 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:30,309 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:30,309 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:30,310 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:30,310 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:30,310 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:30,310 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:30,310 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:30,310 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:30,310 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:30,731 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601011148f0adb25441fb91941c675c0abaa5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011148f0adb25441fb91941c675c0abaa5 2023-02-07 16:56:31,139 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/24ad70b18b8f444fb9f5609dcf93ecb0 2023-02-07 16:56:31,153 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/24ad70b18b8f444fb9f5609dcf93ecb0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/24ad70b18b8f444fb9f5609dcf93ecb0 2023-02-07 16:56:31,158 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/24ad70b18b8f444fb9f5609dcf93ecb0, entries=1, sequenceid=29, filesize=4.9 K 2023-02-07 16:56:31,159 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 849ms, sequenceid=29, compaction requested=true 2023-02-07 16:56:31,160 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:31,160 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:31,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:31,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:31,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:31,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:31,171 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,171 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:31,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:31,172 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,172 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:31,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:31,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:31,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:31,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:31,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fc011d8[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:31,175 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:31,175 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,182 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,182 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:31,182 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:31,182 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:31,182 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,182 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:31,192 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:31,192 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,192 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:31,193 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:31,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:31,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:31,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:31,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:31,200 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:31,201 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:31,201 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:31,201 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,201 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:31,213 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,214 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:31,213 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:31,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:31,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:31,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:31,215 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:31,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:31,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,219 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:31,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,306 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,306 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,306 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,306 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:31,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:31,306 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:31,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:31,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:31,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:31,306 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:31,306 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,306 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:31,307 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:31,308 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:31,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:31,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:31,408 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:31,408 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:31,408 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:31,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:31,413 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:31,413 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:31,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:31,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:31,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,415 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:31,415 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:31,415 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:31,415 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:31,416 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,416 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,445 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:31,445 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:31,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:31,446 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:31,446 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:31,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,446 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:31,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,447 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,447 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:31,447 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:31,448 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:31,448 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:31,448 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:31,448 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:31,448 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:31,448 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:31,448 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:31,448 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:31,870 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010315e329edae90446880bbbaf617c1f1c9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010315e329edae90446880bbbaf617c1f1c9 2023-02-07 16:56:32,280 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/3af48d2528b94357b99cb3da84d73096 2023-02-07 16:56:32,289 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/3af48d2528b94357b99cb3da84d73096 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/3af48d2528b94357b99cb3da84d73096 2023-02-07 16:56:32,296 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/3af48d2528b94357b99cb3da84d73096, entries=1, sequenceid=33, filesize=4.9 K 2023-02-07 16:56:32,297 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 849ms, sequenceid=33, compaction requested=true 2023-02-07 16:56:32,297 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:32,297 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:32,297 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:32,298 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:32,298 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,298 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:32,298 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:32,350 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,350 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:32,351 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,351 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:32,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:32,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:32,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:32,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:32,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52044755[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:32,357 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:32,357 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,368 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,368 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:32,369 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:32,369 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:32,369 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,369 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:32,382 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,382 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:32,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:32,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:32,382 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:32,383 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:32,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:32,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:32,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:32,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:32,390 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:32,390 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:32,391 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:32,391 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,391 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:32,403 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,403 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,403 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:32,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:32,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:32,404 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,406 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:32,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,420 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:32,420 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:32,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:32,421 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:32,420 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:32,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:32,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:32,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:32,420 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,421 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:32,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:32,422 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:32,422 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:32,421 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,422 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,422 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,422 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,522 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:32,523 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:32,523 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:32,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:32,532 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:32,532 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:32,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:32,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:32,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,536 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:32,536 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:32,536 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:32,536 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:32,536 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,537 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,546 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:32,546 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:32,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:32,547 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:32,547 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:32,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,548 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:32,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,549 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,550 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:32,550 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:32,550 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:32,550 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:32,550 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:32,550 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:32,551 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:32,551 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:32,551 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:32,551 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:32,967 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907de86b511b0e049999aeda29e2631ef5a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907de86b511b0e049999aeda29e2631ef5a 2023-02-07 16:56:33,373 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/6873ded9599c4d69b06ab269b744e651 2023-02-07 16:56:33,380 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/6873ded9599c4d69b06ab269b744e651 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6873ded9599c4d69b06ab269b744e651 2023-02-07 16:56:33,389 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6873ded9599c4d69b06ab269b744e651, entries=1, sequenceid=37, filesize=4.9 K 2023-02-07 16:56:33,390 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 839ms, sequenceid=37, compaction requested=true 2023-02-07 16:56:33,390 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:33,390 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:33,390 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:33,390 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:33,390 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,390 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:33,390 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:33,402 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,402 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:33,403 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,403 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:33,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:33,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:33,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a9251e4[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:33,404 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:33,404 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,413 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,413 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:33,413 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:33,413 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:33,414 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,414 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:33,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:33,424 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:33,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,424 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:33,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:33,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:33,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:33,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:33,426 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:33,426 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:33,426 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:33,426 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:33,426 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,426 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:33,434 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,434 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:33,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,434 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:33,434 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,436 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:33,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,444 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,444 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:33,444 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:33,445 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-07 16:56:33,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:33,445 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:33,444 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,444 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:33,444 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:33,445 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:33,445 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,445 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,445 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:33,445 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,445 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:33,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:33,545 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:33,546 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:33,546 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:33,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:33,550 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:33,550 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:33,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:33,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:33,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,552 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:33,552 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:33,552 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-07 16:56:33,552 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-07 16:56:33,553 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,553 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,560 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:33,560 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:33,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:33,561 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:33,561 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:33,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:33,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,561 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,562 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-07 16:56:33,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:33,562 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-07 16:56:33,562 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:33,562 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-07 16:56:33,562 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:33,562 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:33,562 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:33,562 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. started... 2023-02-07 16:56:33,562 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing a4c0a29d4ff41edc8f2623eb67694c5b 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:33,978 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200dd3f5a2399142fcaade911fbd7419dc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511200dd3f5a2399142fcaade911fbd7419dc 2023-02-07 16:56:34,385 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/d1b62771578046fba8074160b829f385 2023-02-07 16:56:34,391 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/d1b62771578046fba8074160b829f385 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/d1b62771578046fba8074160b829f385 2023-02-07 16:56:34,396 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/d1b62771578046fba8074160b829f385, entries=1, sequenceid=41, filesize=4.9 K 2023-02-07 16:56:34,397 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for a4c0a29d4ff41edc8f2623eb67694c5b in 835ms, sequenceid=41, compaction requested=true 2023-02-07 16:56:34,397 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:34,397 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:34,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:34,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:34,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-07 16:56:34,397 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-07 16:56:34,445 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,445 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:34,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:34,445 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:34,446 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:34,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:34,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:34,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-07 16:56:34,449 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-07 16:56:34,449 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11c39880[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:34,450 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,462 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,463 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-07 16:56:34,463 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-07 16:56:34,463 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:34,463 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,463 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:34,476 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,476 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-07 16:56:34,476 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:34,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:34,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:34,477 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-07 16:56:34,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:34,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:56:34,485 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-07 16:56:34,485 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:34,485 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:34,485 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,485 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:34,528 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,528 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:34,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,528 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:34,528 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:34,528 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:34,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:34,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,530 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:34,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:34,550 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,550 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-07 16:56:34,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:34,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:34,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:34,551 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:34,551 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:34,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:34,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:34,651 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:34,651 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:34,651 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:34,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:34,653 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-07 16:56:34,655 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:56:34,656 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:56:34,657 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:34,657 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789594657 2023-02-07 16:56:34,660 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:56:34,661 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-07 16:56:34,662 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:34,662 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x6e06f125 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:56:34,677 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43b72d51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:56:34,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,526 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010347bce74b398a4a60aa9c43cbe61a10f3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010347bce74b398a4a60aa9c43cbe61a10f3 2023-02-07 16:56:35,528 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:35,544 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:56:35,545 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45006, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:56:35,552 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:35,552 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:35,552 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:56:35,553 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:44424, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:56:35,563 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/309da12da1d14b05add3454ec959dc76 first=Optional[r3] last=Optional[r6] 2023-02-07 16:56:35,564 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/309da12da1d14b05add3454ec959dc76}] 2023-02-07 16:56:35,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/309da12da1d14b05add3454ec959dc76 for inclusion in a4c0a29d4ff41edc8f2623eb67694c5b/family1 2023-02-07 16:56:35,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-07 16:56:35,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:35,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:35,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/309da12da1d14b05add3454ec959dc76 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3iri4kmn65os7ikqj8g0gin9bsf5a0bc3n9g4ksh3ck8rn2h74vkt9m4r4a7vb8a/family1/309da12da1d14b05add3454ec959dc76 2023-02-07 16:56:35,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3iri4kmn65os7ikqj8g0gin9bsf5a0bc3n9g4ksh3ck8rn2h74vkt9m4r4a7vb8a/family1/309da12da1d14b05add3454ec959dc76 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/4ec61515837f4666b0e26fa146e14f53_SeqId_44_ 2023-02-07 16:56:35,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3iri4kmn65os7ikqj8g0gin9bsf5a0bc3n9g4ksh3ck8rn2h74vkt9m4r4a7vb8a/family1/309da12da1d14b05add3454ec959dc76 into a4c0a29d4ff41edc8f2623eb67694c5b/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/4ec61515837f4666b0e26fa146e14f53_SeqId_44_ - updating store file list. 2023-02-07 16:56:35,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/4ec61515837f4666b0e26fa146e14f53_SeqId_44_ into a4c0a29d4ff41edc8f2623eb67694c5b/family1 2023-02-07 16:56:35,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3iri4kmn65os7ikqj8g0gin9bsf5a0bc3n9g4ksh3ck8rn2h74vkt9m4r4a7vb8a/family1/309da12da1d14b05add3454ec959dc76 into a4c0a29d4ff41edc8f2623eb67694c5b/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/4ec61515837f4666b0e26fa146e14f53_SeqId_44_) 2023-02-07 16:56:35,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__3iri4kmn65os7ikqj8g0gin9bsf5a0bc3n9g4ksh3ck8rn2h74vkt9m4r4a7vb8a/family1/309da12da1d14b05add3454ec959dc76 2023-02-07 16:56:35,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-07 16:56:35,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-07 16:56:35,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): a4c0a29d4ff41edc8f2623eb67694c5b/family1 is initiating minor compaction 2023-02-07 16:56:35,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@62355a66; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:35,582 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of a4c0a29d4ff41edc8f2623eb67694c5b/family1 in testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:35,582 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/ef62b0e16af94c729644feb265a75184, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6b8df2977b384fe29fa869a988aeb2c2, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/944cd63e7d3542e9beb1500b297f406d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/268f1c044a1b4f798c89f08fe658daee, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/171f52ad439e42e2b4c13e3e334f75cb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/24ad70b18b8f444fb9f5609dcf93ecb0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/3af48d2528b94357b99cb3da84d73096, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6873ded9599c4d69b06ab269b744e651, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/d1b62771578046fba8074160b829f385, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/4ec61515837f4666b0e26fa146e14f53_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp, totalSize=50.0 K 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting ef62b0e16af94c729644feb265a75184, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 6b8df2977b384fe29fa869a988aeb2c2, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 944cd63e7d3542e9beb1500b297f406d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 268f1c044a1b4f798c89f08fe658daee, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 171f52ad439e42e2b4c13e3e334f75cb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 24ad70b18b8f444fb9f5609dcf93ecb0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 3af48d2528b94357b99cb3da84d73096, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 6873ded9599c4d69b06ab269b744e651, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting d1b62771578046fba8074160b829f385, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-07 16:56:35,583 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 4ec61515837f4666b0e26fa146e14f53_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-07 16:56:35,585 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:35,585 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:35,587 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228cb339358840047deb09063c9d3700ecd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228cb339358840047deb09063c9d3700ecd 2023-02-07 16:56:35,588 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123143598f59061d4a2b80281c3228e8e159 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123143598f59061d4a2b80281c3228e8e159 2023-02-07 16:56:35,589 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011148f0adb25441fb91941c675c0abaa5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601011148f0adb25441fb91941c675c0abaa5 2023-02-07 16:56:35,590 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010315e329edae90446880bbbaf617c1f1c9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010315e329edae90446880bbbaf617c1f1c9 2023-02-07 16:56:35,590 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-07 16:56:35,590 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-07 16:56:35,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,590 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,591 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,591 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,591 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:35,619 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): a4c0a29d4ff41edc8f2623eb67694c5b#family1#compaction#49 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:56:36,441 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/0ef92925a86e4fad920d2d93c140c56f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/0ef92925a86e4fad920d2d93c140c56f 2023-02-07 16:56:36,450 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in a4c0a29d4ff41edc8f2623eb67694c5b/family1 of a4c0a29d4ff41edc8f2623eb67694c5b into 0ef92925a86e4fad920d2d93c140c56f(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:56:36,450 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:36,450 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675788995582; duration=0sec 2023-02-07 16:56:36,450 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:36,460 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205abc47403a4174426a3a9772be249e558 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205abc47403a4174426a3a9772be249e558 2023-02-07 16:56:36,462 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:36,480 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:36,480 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:36,489 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eaa5be70c9394d8dafc57408f3944905 first=Optional[r00] last=Optional[r2] 2023-02-07 16:56:36,489 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eaa5be70c9394d8dafc57408f3944905}] 2023-02-07 16:56:36,491 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eaa5be70c9394d8dafc57408f3944905 for inclusion in a4c0a29d4ff41edc8f2623eb67694c5b/family1 2023-02-07 16:56:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-07 16:56:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:36,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:36,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eaa5be70c9394d8dafc57408f3944905 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__bm1t4h1iuiosrbuedd0np5i221qsdh3qgu568p4gihhf0f729dqio57qokfjmphp/family1/eaa5be70c9394d8dafc57408f3944905 2023-02-07 16:56:36,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__bm1t4h1iuiosrbuedd0np5i221qsdh3qgu568p4gihhf0f729dqio57qokfjmphp/family1/eaa5be70c9394d8dafc57408f3944905 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/b2fd4697a62949658db328a42ce1a13a_SeqId_47_ 2023-02-07 16:56:36,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__bm1t4h1iuiosrbuedd0np5i221qsdh3qgu568p4gihhf0f729dqio57qokfjmphp/family1/eaa5be70c9394d8dafc57408f3944905 into a4c0a29d4ff41edc8f2623eb67694c5b/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/b2fd4697a62949658db328a42ce1a13a_SeqId_47_ - updating store file list. 2023-02-07 16:56:36,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/b2fd4697a62949658db328a42ce1a13a_SeqId_47_ into a4c0a29d4ff41edc8f2623eb67694c5b/family1 2023-02-07 16:56:36,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__bm1t4h1iuiosrbuedd0np5i221qsdh3qgu568p4gihhf0f729dqio57qokfjmphp/family1/eaa5be70c9394d8dafc57408f3944905 into a4c0a29d4ff41edc8f2623eb67694c5b/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/b2fd4697a62949658db328a42ce1a13a_SeqId_47_) 2023-02-07 16:56:36,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyPolicy__bm1t4h1iuiosrbuedd0np5i221qsdh3qgu568p4gihhf0f729dqio57qokfjmphp/family1/eaa5be70c9394d8dafc57408f3944905 2023-02-07 16:56:36,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-07 16:56:36,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-07 16:56:36,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): a4c0a29d4ff41edc8f2623eb67694c5b/family1 is initiating minor compaction (all files) 2023-02-07 16:56:36,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2c2b363a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-07 16:56:36,503 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegion(2258): Starting compaction of a4c0a29d4ff41edc8f2623eb67694c5b/family1 in testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:56:36,504 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/982e92eed91947db85d90df7b771dc11, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/0ef92925a86e4fad920d2d93c140c56f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/b2fd4697a62949658db328a42ce1a13a_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp, totalSize=337.0 K 2023-02-07 16:56:36,504 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting 982e92eed91947db85d90df7b771dc11, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828694 2023-02-07 16:56:36,504 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting 0ef92925a86e4fad920d2d93c140c56f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228694 2023-02-07 16:56:36,505 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting b2fd4697a62949658db328a42ce1a13a_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878828694 2023-02-07 16:56:36,506 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:36,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:36,508 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f42928e51a8b4f5694c8af4353a2f9f0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130f42928e51a8b4f5694c8af4353a2f9f0 2023-02-07 16:56:36,509 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc5402553d684c57aa02ca4a09662692 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201bc5402553d684c57aa02ca4a09662692 2023-02-07 16:56:36,510 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b6dc100efc1b4c1d9dbb7711d0a13c90 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151205b6dc100efc1b4c1d9dbb7711d0a13c90 2023-02-07 16:56:36,510 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-07 16:56:36,510 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-07 16:56:36,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-07 16:56:36,511 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-07 16:56:36,511 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:36,513 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:56:36,515 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.8590 sec 2023-02-07 16:56:36,524 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] throttle.PressureAwareThroughputController(145): a4c0a29d4ff41edc8f2623eb67694c5b#family1#compaction#50 average throughput is 17.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:56:36,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/ef62b0e16af94c729644feb265a75184, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6b8df2977b384fe29fa869a988aeb2c2, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/944cd63e7d3542e9beb1500b297f406d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/268f1c044a1b4f798c89f08fe658daee, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/171f52ad439e42e2b4c13e3e334f75cb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/24ad70b18b8f444fb9f5609dcf93ecb0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/3af48d2528b94357b99cb3da84d73096, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6873ded9599c4d69b06ab269b744e651, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/d1b62771578046fba8074160b829f385, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/4ec61515837f4666b0e26fa146e14f53_SeqId_44_] to archive 2023-02-07 16:56:36,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:36,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/ef62b0e16af94c729644feb265a75184 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/ef62b0e16af94c729644feb265a75184 2023-02-07 16:56:36,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6b8df2977b384fe29fa869a988aeb2c2 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6b8df2977b384fe29fa869a988aeb2c2 2023-02-07 16:56:36,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/944cd63e7d3542e9beb1500b297f406d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/944cd63e7d3542e9beb1500b297f406d 2023-02-07 16:56:36,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/268f1c044a1b4f798c89f08fe658daee to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/268f1c044a1b4f798c89f08fe658daee 2023-02-07 16:56:36,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/171f52ad439e42e2b4c13e3e334f75cb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/171f52ad439e42e2b4c13e3e334f75cb 2023-02-07 16:56:36,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/24ad70b18b8f444fb9f5609dcf93ecb0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/24ad70b18b8f444fb9f5609dcf93ecb0 2023-02-07 16:56:36,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/3af48d2528b94357b99cb3da84d73096 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/3af48d2528b94357b99cb3da84d73096 2023-02-07 16:56:36,573 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6873ded9599c4d69b06ab269b744e651 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6873ded9599c4d69b06ab269b744e651 2023-02-07 16:56:36,574 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/d1b62771578046fba8074160b829f385 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/d1b62771578046fba8074160b829f385 2023-02-07 16:56:36,575 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/4ec61515837f4666b0e26fa146e14f53_SeqId_44_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/4ec61515837f4666b0e26fa146e14f53_SeqId_44_ 2023-02-07 16:56:36,608 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=251 (was 242) - Thread LEAK? -, OpenFileDescriptor=609 (was 590) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 257) - SystemLoadAverage LEAK? -, ProcessCount=174 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=2923 (was 3174) 2023-02-07 16:56:36,619 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=251, OpenFileDescriptor=609, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=174, AvailableMemoryMB=2922 2023-02-07 16:56:36,620 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:36,620 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:36,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-07 16:56:36,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:36,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:56:36,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-07 16:56:36,624 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:36,624 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:36,624 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:56:36,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-07 16:56:36,625 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:36,626 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea empty. 2023-02-07 16:56:36,626 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:36,626 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-07 16:56:36,725 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:36,725 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:36,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-07 16:56:36,928 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:36,928 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:36,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-07 16:56:37,037 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-07 16:56:37,040 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => d1a26f234ebcf2124a50eb6cbef42dea, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:56:37,231 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:37,231 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:37,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-07 16:56:37,452 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:37,452 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing d1a26f234ebcf2124a50eb6cbef42dea, disabling compactions & flushes 2023-02-07 16:56:37,452 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:37,452 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:37,452 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. after waiting 0 ms 2023-02-07 16:56:37,452 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:37,452 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:37,452 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for d1a26f234ebcf2124a50eb6cbef42dea: Waiting for close lock at 1675788997452Disabling compacts and flushes for region at 1675788997452Disabling writes for close at 1675788997452Writing region close event to WAL at 1675788997452Closed at 1675788997452 2023-02-07 16:56:37,455 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:56:37,455 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675788997455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675788997455"}]},"ts":"1675788997455"} 2023-02-07 16:56:37,457 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:56:37,458 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:56:37,458 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788997458"}]},"ts":"1675788997458"} 2023-02-07 16:56:37,459 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-07 16:56:37,518 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, ASSIGN}] 2023-02-07 16:56:37,520 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, ASSIGN 2023-02-07 16:56:37,522 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:56:37,673 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:37,673 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675788997673"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675788997673"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675788997673"}]},"ts":"1675788997673"} 2023-02-07 16:56:37,675 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:37,733 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:37,734 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:37,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-07 16:56:37,767 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/.tmp/family1/6f0a09be38fd49d5b762c7b9284d04c8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/6f0a09be38fd49d5b762c7b9284d04c8 2023-02-07 16:56:37,772 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in a4c0a29d4ff41edc8f2623eb67694c5b/family1 of a4c0a29d4ff41edc8f2623eb67694c5b into 6f0a09be38fd49d5b762c7b9284d04c8(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:56:37,772 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for a4c0a29d4ff41edc8f2623eb67694c5b: 2023-02-07 16:56:37,772 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1675788996503; duration=1sec 2023-02-07 16:56:37,772 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:37,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:37,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d1a26f234ebcf2124a50eb6cbef42dea, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:56:37,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:37,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:37,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:37,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:37,836 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:37,839 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:37,839 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:37,839 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1a26f234ebcf2124a50eb6cbef42dea columnFamilyName family1 2023-02-07 16:56:37,842 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(310): Store=d1a26f234ebcf2124a50eb6cbef42dea/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:37,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:37,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:37,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/982e92eed91947db85d90df7b771dc11, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/0ef92925a86e4fad920d2d93c140c56f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/b2fd4697a62949658db328a42ce1a13a_SeqId_47_] to archive 2023-02-07 16:56:37,849 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:37,851 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:37,851 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/982e92eed91947db85d90df7b771dc11 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/982e92eed91947db85d90df7b771dc11 2023-02-07 16:56:37,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:56:37,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/0ef92925a86e4fad920d2d93c140c56f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/0ef92925a86e4fad920d2d93c140c56f 2023-02-07 16:56:37,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened d1a26f234ebcf2124a50eb6cbef42dea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67514144, jitterRate=0.006039142608642578}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:56:37,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for d1a26f234ebcf2124a50eb6cbef42dea: Running coprocessor pre-open hook at 1675788997833Writing region info on filesystem at 1675788997833Initializing all the Stores at 1675788997835 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675788997835Cleaning up temporary data from old regions at 1675788997844 (+9 ms)Cleaning up detritus from prior splits at 1675788997845 (+1 ms)Running coprocessor post-open hooks at 1675788997853 (+8 ms)Region opened successfully at 1675788997853 2023-02-07 16:56:37,854 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea., pid=41, masterSystemTime=1675788997827 2023-02-07 16:56:37,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/b2fd4697a62949658db328a42ce1a13a_SeqId_47_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/family1/b2fd4697a62949658db328a42ce1a13a_SeqId_47_ 2023-02-07 16:56:37,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:37,855 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:37,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:37,856 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675788997856"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675788997856"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675788997856"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675788997856"}]},"ts":"1675788997856"} 2023-02-07 16:56:37,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-07 16:56:37,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983 in 182 msec 2023-02-07 16:56:37,860 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-07 16:56:37,860 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, ASSIGN in 340 msec 2023-02-07 16:56:37,860 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:56:37,860 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675788997860"}]},"ts":"1675788997860"} 2023-02-07 16:56:37,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-07 16:56:37,873 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:56:37,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.2520 sec 2023-02-07 16:56:38,281 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:38,735 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:38,735 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:38,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-07 16:56:38,736 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-07 16:56:38,766 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:38,766 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:38,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:38,784 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:56:38,785 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e06f125 to 127.0.0.1:56335 2023-02-07 16:56:38,785 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:56:38,785 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:56:38,785 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1315131c to 127.0.0.1:56335 2023-02-07 16:56:38,785 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:56:38,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:38,785 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:56:38,786 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:38,786 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6969138a to 127.0.0.1:56335 2023-02-07 16:56:38,786 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:38,786 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:56:38,786 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:38,786 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:38,802 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:38,802 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:38,813 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:38,813 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:38,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:38,813 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:38,813 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:38,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:38,814 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:38,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:38,814 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:38,814 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:38,814 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:38,814 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:38,814 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:38,814 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:38,814 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:38,815 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-07 16:56:38,835 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130335be0ccd89048a58c3c0336d6ce01c8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130335be0ccd89048a58c3c0336d6ce01c8 2023-02-07 16:56:39,240 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/d132261a6da44b9c82e6939bc4a4a88f 2023-02-07 16:56:39,244 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/d132261a6da44b9c82e6939bc4a4a88f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d132261a6da44b9c82e6939bc4a4a88f 2023-02-07 16:56:39,248 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d132261a6da44b9c82e6939bc4a4a88f, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-07 16:56:39,249 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 434ms, sequenceid=5, compaction requested=false 2023-02-07 16:56:39,250 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:39,250 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:39,250 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:39,250 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:39,250 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,250 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:39,250 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:39,265 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,265 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:39,266 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,266 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:39,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:39,267 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e0205b1[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:39,267 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:39,268 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,276 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,276 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:39,276 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:39,276 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:39,276 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,276 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:39,286 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,286 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:39,286 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:39,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,286 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:39,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:39,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:39,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:39,289 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:39,289 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:39,289 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:39,289 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,289 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:39,297 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,297 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,297 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:39,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:39,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:39,298 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:39,298 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:39,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:39,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:39,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,299 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:39,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:39,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:39,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:39,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:39,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:39,307 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,308 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,308 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:39,308 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:39,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:39,308 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:39,308 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:39,308 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,308 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:39,308 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,309 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,409 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:39,409 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:39,409 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:39,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:39,413 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:39,413 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:39,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:39,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:39,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,416 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:39,416 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:39,416 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:39,416 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:39,416 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,416 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,434 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,434 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:39,434 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:39,434 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:39,434 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:39,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,435 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:39,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,435 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,435 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:39,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:39,435 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:39,435 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:39,435 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:39,436 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:39,436 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:39,436 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:39,436 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:39,436 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-07 16:56:39,849 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128f5f2608fb6af4d5c958eefe287dadfd6 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128f5f2608fb6af4d5c958eefe287dadfd6 2023-02-07 16:56:40,255 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/d2dc50f57a944b15b11045dfe67570c0 2023-02-07 16:56:40,261 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/d2dc50f57a944b15b11045dfe67570c0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d2dc50f57a944b15b11045dfe67570c0 2023-02-07 16:56:40,268 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d2dc50f57a944b15b11045dfe67570c0, entries=1, sequenceid=9, filesize=5.0 K 2023-02-07 16:56:40,269 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 833ms, sequenceid=9, compaction requested=false 2023-02-07 16:56:40,269 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:40,269 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:40,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:40,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:40,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:40,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:40,318 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,318 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:40,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:40,319 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:40,319 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:40,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:40,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:40,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e4cc7cb[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:40,323 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:40,323 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,335 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,336 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:40,336 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:40,336 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:40,336 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,336 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:40,346 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:40,346 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,346 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:40,346 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:40,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:40,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:40,348 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:40,348 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:40,349 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:40,349 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,349 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:40,367 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,367 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:40,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,367 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:40,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:40,368 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,369 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,404 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,404 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:40,404 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,404 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:40,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:40,404 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:40,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:40,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:40,404 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:40,405 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,405 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,405 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,405 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,405 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:40,405 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:40,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:40,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:40,505 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:40,506 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:40,506 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:40,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:40,509 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:40,510 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:40,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:40,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:40,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,513 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:40,513 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:40,513 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:40,513 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:40,514 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,514 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,525 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,525 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:40,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:40,526 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:40,526 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,526 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,527 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:40,527 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:40,527 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:40,527 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:40,527 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:40,527 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:40,527 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:40,527 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:40,527 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:40,527 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:40,940 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201987ab742103c4280a3d657674ad06c79 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201987ab742103c4280a3d657674ad06c79 2023-02-07 16:56:41,345 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/657167bc4a4547cb9516793ac79e2b2e 2023-02-07 16:56:41,354 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/657167bc4a4547cb9516793ac79e2b2e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/657167bc4a4547cb9516793ac79e2b2e 2023-02-07 16:56:41,361 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/657167bc4a4547cb9516793ac79e2b2e, entries=1, sequenceid=13, filesize=5.0 K 2023-02-07 16:56:41,362 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 835ms, sequenceid=13, compaction requested=true 2023-02-07 16:56:41,362 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:41,362 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:41,363 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:41,363 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:41,363 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,363 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:41,363 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:41,370 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,370 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:41,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:41,371 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,371 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:41,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:41,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@639b697[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:41,372 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:41,372 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,381 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,381 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:41,381 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:41,381 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:41,381 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,381 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:41,391 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,391 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:41,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:41,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:41,392 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:41,392 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:41,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:41,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:41,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:41,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:41,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:41,396 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:41,396 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:41,396 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:41,396 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,396 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:41,409 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,409 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,409 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:41,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:41,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:41,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:41,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:41,410 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:41,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:41,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,412 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:41,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:41,423 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:41,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:41,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:41,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:41,423 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:41,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:41,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:41,424 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,424 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,424 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,424 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:41,425 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:41,424 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:41,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:41,525 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:41,525 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:41,525 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:41,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:41,534 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:41,535 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:41,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:41,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:41,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,540 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:41,540 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:41,540 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:41,540 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:41,541 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,541 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,571 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,571 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:41,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:41,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:41,571 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:41,571 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:41,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:41,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,573 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,574 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:41,574 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:41,574 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:41,574 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:41,574 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:41,575 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:41,575 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:41,575 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:41,575 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:41,575 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:41,994 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052a419c3b21e94e419a80af218f2acec3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052a419c3b21e94e419a80af218f2acec3 2023-02-07 16:56:42,401 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/ef9722e9c33a4a36b9b23c08e4b4e7b9 2023-02-07 16:56:42,406 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/ef9722e9c33a4a36b9b23c08e4b4e7b9 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/ef9722e9c33a4a36b9b23c08e4b4e7b9 2023-02-07 16:56:42,410 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/ef9722e9c33a4a36b9b23c08e4b4e7b9, entries=1, sequenceid=17, filesize=5.0 K 2023-02-07 16:56:42,411 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 836ms, sequenceid=17, compaction requested=true 2023-02-07 16:56:42,411 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:42,411 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:42,411 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:42,411 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:42,411 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,412 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:42,412 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:42,423 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:42,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,423 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:42,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:42,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:42,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:42,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b333948[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:42,424 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:42,424 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,433 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,434 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:42,434 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,434 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:42,434 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:42,434 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:42,454 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,454 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,455 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:42,455 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:42,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:42,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:42,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:42,457 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:42,457 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:42,457 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:42,457 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,457 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:42,465 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,465 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:42,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:42,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,465 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:42,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:42,465 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,466 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,475 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,475 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:42,475 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:42,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:42,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:42,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:42,475 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:42,475 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:42,476 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,476 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,476 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,476 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:42,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:42,476 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:42,476 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:42,476 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,576 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:42,576 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:42,577 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:42,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:42,582 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:42,582 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:42,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:42,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:42,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,585 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:42,585 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:42,585 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:42,585 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:42,585 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,586 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,619 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,619 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:42,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:42,619 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:42,619 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,620 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,620 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:42,621 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:42,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:42,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:42,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:42,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:42,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:42,621 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:42,621 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:42,621 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:43,045 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512289a90cbda7b2f4059b3cc46b4d7a63f2b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512289a90cbda7b2f4059b3cc46b4d7a63f2b 2023-02-07 16:56:43,361 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:56:43,453 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/a8fc93552764424f8c24a9565a210096 2023-02-07 16:56:43,458 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/a8fc93552764424f8c24a9565a210096 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a8fc93552764424f8c24a9565a210096 2023-02-07 16:56:43,465 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a8fc93552764424f8c24a9565a210096, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 16:56:43,465 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 844ms, sequenceid=21, compaction requested=true 2023-02-07 16:56:43,466 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:43,466 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:43,466 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:43,466 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:43,466 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,466 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:43,466 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:43,539 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,539 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:43,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:43,540 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,540 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:43,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:43,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:43,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:43,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5928a12[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:43,544 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:43,544 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,557 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,557 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:43,557 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:43,557 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:43,558 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,558 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:43,570 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:43,571 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,571 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:43,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:43,571 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:43,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:43,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:43,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:43,578 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:43,578 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:43,578 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:43,578 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,578 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:43,591 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,591 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:43,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:43,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,591 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:43,592 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,592 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:43,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,593 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:43,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:43,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:43,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:43,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:43,602 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:43,602 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:43,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:43,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:43,703 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:43,703 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:43,703 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:43,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:43,707 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:43,707 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:43,707 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:43,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:43,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,709 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:43,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:43,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:43,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:43,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,718 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,718 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:43,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:43,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:43,718 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:43,718 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:43,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:43,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,719 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,719 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:43,719 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:43,719 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:43,720 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:43,720 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:43,720 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:43,720 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:43,720 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:43,720 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:43,720 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:44,139 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123104e52b03525d47b081d2ce4545b820ae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123104e52b03525d47b081d2ce4545b820ae 2023-02-07 16:56:44,545 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/2d03b8c904f74215a3751db6198b5493 2023-02-07 16:56:44,550 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/2d03b8c904f74215a3751db6198b5493 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/2d03b8c904f74215a3751db6198b5493 2023-02-07 16:56:44,554 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/2d03b8c904f74215a3751db6198b5493, entries=1, sequenceid=25, filesize=5.0 K 2023-02-07 16:56:44,554 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 834ms, sequenceid=25, compaction requested=true 2023-02-07 16:56:44,555 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:44,555 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:44,555 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:44,555 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:44,555 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,555 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:44,555 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:44,570 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,570 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:44,571 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,571 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:44,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:44,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:44,573 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d6867f4[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:44,573 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:44,573 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,591 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,591 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,592 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:44,592 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:44,592 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:44,592 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,592 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:44,602 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:44,602 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,602 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:44,602 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:44,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:44,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:44,611 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:44,611 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:44,611 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:44,612 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,612 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:44,623 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,623 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:44,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:44,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,623 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:44,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:44,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:44,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:44,624 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:44,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,628 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:44,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:44,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,641 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:44,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:44,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:44,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:44,641 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:44,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:44,642 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:44,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:44,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:44,642 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,642 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,642 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:44,642 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,642 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:44,743 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:44,743 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:44,743 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:44,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:44,750 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:44,750 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:44,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:44,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:44,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,755 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:44,755 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:44,755 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:44,755 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:44,756 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,756 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,778 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,778 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:44,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:44,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:44,779 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:44,779 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:44,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,781 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,782 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,782 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:44,783 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:44,783 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:44,783 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:44,783 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:44,783 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:44,784 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:44,784 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:44,784 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:44,784 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:45,200 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101578f13a078424b509d186c1143284d18 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101578f13a078424b509d186c1143284d18 2023-02-07 16:56:45,607 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/0dc6b9ff93514f5d8f343216f19d2732 2023-02-07 16:56:45,619 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/0dc6b9ff93514f5d8f343216f19d2732 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/0dc6b9ff93514f5d8f343216f19d2732 2023-02-07 16:56:45,625 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/0dc6b9ff93514f5d8f343216f19d2732, entries=1, sequenceid=29, filesize=5.0 K 2023-02-07 16:56:45,626 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 842ms, sequenceid=29, compaction requested=true 2023-02-07 16:56:45,626 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:45,627 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:45,627 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:45,627 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:45,627 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,627 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:45,627 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:45,633 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,633 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:45,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:45,634 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,634 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:45,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:45,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:45,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:45,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:45,637 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46aef5c0[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:45,637 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:45,637 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,644 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,644 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:45,644 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:45,644 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:45,644 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,644 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:45,705 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:45,705 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:45,705 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:45,705 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:45,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:45,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:45,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:45,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:45,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:45,708 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:45,708 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:45,708 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:45,708 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,708 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:45,728 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,728 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:45,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,728 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:45,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:45,729 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,730 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:45,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:45,749 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:45,749 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:45,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:45,749 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:45,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:45,749 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:45,750 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,750 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,850 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:45,850 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:45,850 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:45,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:45,856 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:45,856 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:45,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:45,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:45,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,858 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:45,858 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:45,858 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:45,858 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:45,858 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,859 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,865 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:45,865 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:45,865 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:45,865 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:45,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,866 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:45,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,866 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,866 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:45,866 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:45,867 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:45,867 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:45,867 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:45,867 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:45,867 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:45,867 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:45,867 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:45,867 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:46,285 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d66f6aff80504cd8bc7242e28cffa70b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d66f6aff80504cd8bc7242e28cffa70b 2023-02-07 16:56:46,694 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/8806f15760dc490fb0ec86332c55d9ae 2023-02-07 16:56:46,704 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/8806f15760dc490fb0ec86332c55d9ae as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/8806f15760dc490fb0ec86332c55d9ae 2023-02-07 16:56:46,709 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/8806f15760dc490fb0ec86332c55d9ae, entries=1, sequenceid=33, filesize=5.0 K 2023-02-07 16:56:46,710 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 843ms, sequenceid=33, compaction requested=true 2023-02-07 16:56:46,710 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:46,711 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:46,711 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:46,711 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:46,711 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,711 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:46,711 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:46,738 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:46,739 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,739 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:46,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:46,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:46,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54456d24[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:46,741 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:46,742 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,823 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,824 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:46,824 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:46,824 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:46,824 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,824 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:46,873 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:46,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,874 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:46,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:46,874 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:46,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:46,879 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:46,879 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:46,880 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:46,880 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:46,880 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,880 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:46,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:46,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:46,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:46,971 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:46,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:46,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:46,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,976 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:46,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:46,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:46,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:47,036 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:47,036 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,036 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,036 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:47,036 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,036 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:47,036 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:47,037 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:47,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:47,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:47,036 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:47,036 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:47,038 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:47,037 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,038 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:47,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:47,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:47,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:47,138 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:47,139 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:47,139 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:47,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:47,147 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:47,147 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:47,148 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:47,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:47,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,150 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:47,150 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:47,150 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:47,150 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:47,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,246 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:47,246 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:47,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:47,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:47,246 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,247 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:47,247 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:47,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,247 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,247 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:47,247 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:47,247 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:47,247 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:47,248 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:47,248 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:47,248 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:47,248 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:47,248 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:47,248 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:47,659 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078d9dd4ce7c854b83a94d4012a8df72fb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509078d9dd4ce7c854b83a94d4012a8df72fb 2023-02-07 16:56:48,065 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/3017f72f1fad496cbf12b2fad789845a 2023-02-07 16:56:48,076 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/3017f72f1fad496cbf12b2fad789845a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3017f72f1fad496cbf12b2fad789845a 2023-02-07 16:56:48,082 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3017f72f1fad496cbf12b2fad789845a, entries=1, sequenceid=37, filesize=5.0 K 2023-02-07 16:56:48,082 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 834ms, sequenceid=37, compaction requested=true 2023-02-07 16:56:48,083 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:48,083 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:48,083 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:48,083 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:48,083 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,083 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:48,083 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:48,093 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,093 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:48,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:48,094 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,094 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:48,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:48,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:48,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4516afa4[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:48,096 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:48,096 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,107 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,107 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:48,107 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,107 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:48,107 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:48,107 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:48,117 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:48,117 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:48,117 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,117 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:48,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:48,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:48,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:48,120 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:48,120 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:48,120 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:48,120 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,120 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:48,128 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,128 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:48,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,128 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:48,128 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:48,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:48,129 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:48,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,190 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,191 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,191 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,191 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:48,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:48,190 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:48,191 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:48,191 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,191 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,191 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,191 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:48,191 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:48,191 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:48,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:48,192 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:48,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:48,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:48,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:48,292 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:48,292 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:48,293 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:48,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:48,304 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:48,304 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:48,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:48,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:48,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,309 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:48,309 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:48,309 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-07 16:56:48,309 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-07 16:56:48,309 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,309 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,317 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:48,317 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:48,318 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:48,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,318 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:48,319 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:48,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,320 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,320 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-07 16:56:48,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:48,320 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-07 16:56:48,320 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:48,320 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-07 16:56:48,321 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:48,321 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:48,321 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:48,321 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. started... 2023-02-07 16:56:48,321 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing d1a26f234ebcf2124a50eb6cbef42dea 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:48,742 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205d0ac6d6bbbe446483390e961972b030 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205d0ac6d6bbbe446483390e961972b030 2023-02-07 16:56:49,152 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/4ce9041b8a79407c91c410c82b2ca6cb 2023-02-07 16:56:49,156 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/4ce9041b8a79407c91c410c82b2ca6cb as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/4ce9041b8a79407c91c410c82b2ca6cb 2023-02-07 16:56:49,160 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/4ce9041b8a79407c91c410c82b2ca6cb, entries=1, sequenceid=41, filesize=5.0 K 2023-02-07 16:56:49,161 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for d1a26f234ebcf2124a50eb6cbef42dea in 840ms, sequenceid=41, compaction requested=true 2023-02-07 16:56:49,161 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:49,161 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:49,161 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:49,161 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:49,161 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,161 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-07 16:56:49,161 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-07 16:56:49,170 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,170 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:49,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:49,170 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,170 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:49,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:49,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-07 16:56:49,172 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b8f3735[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:49,172 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-07 16:56:49,172 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,180 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,181 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-07 16:56:49,181 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-07 16:56:49,181 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,181 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:49,181 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:49,191 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,191 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-07 16:56:49,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:49,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:49,191 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:49,191 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-07 16:56:49,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:49,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:49,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:49,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:49,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-07 16:56:49,197 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-07 16:56:49,198 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:49,198 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:49,198 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,198 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:49,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:49,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:49,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:49,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,211 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:49,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,214 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:49,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:49,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-07 16:56:49,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:49,223 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:49,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:49,223 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:49,223 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:49,223 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,223 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:49,223 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,223 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,223 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:49,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-07 16:56:49,223 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:49,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:49,324 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:49,324 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:49,324 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:49,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:49,328 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:49,329 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:49,330 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:49,331 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:49,331 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789609331 2023-02-07 16:56:49,333 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:56:49,335 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-07 16:56:49,335 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:49,335 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x6821b45e to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:56:49,349 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6842d3a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:56:49,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,203 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038eab194915a146e4b343d8889d3f65ff to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601038eab194915a146e4b343d8889d3f65ff 2023-02-07 16:56:50,204 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:50,219 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:56:50,220 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:54944, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:56:50,225 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:50,226 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:50,226 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:56:50,228 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56520, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:56:50,237 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2107fcaeb95946a7ad665a7398bc53b0 first=Optional[r3] last=Optional[r6] 2023-02-07 16:56:50,238 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2107fcaeb95946a7ad665a7398bc53b0}] 2023-02-07 16:56:50,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2107fcaeb95946a7ad665a7398bc53b0 for inclusion in d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:50,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-07 16:56:50,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:50,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:50,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/2107fcaeb95946a7ad665a7398bc53b0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gpgdkdkflu5a14ef0tmo0ji00n989h1ac8vs7dvjoqun9ug80ekvrgask6apm97m/family1/2107fcaeb95946a7ad665a7398bc53b0 2023-02-07 16:56:50,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gpgdkdkflu5a14ef0tmo0ji00n989h1ac8vs7dvjoqun9ug80ekvrgask6apm97m/family1/2107fcaeb95946a7ad665a7398bc53b0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3fc7f131496b42f487d3823dfb71ca39_SeqId_44_ 2023-02-07 16:56:50,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gpgdkdkflu5a14ef0tmo0ji00n989h1ac8vs7dvjoqun9ug80ekvrgask6apm97m/family1/2107fcaeb95946a7ad665a7398bc53b0 into d1a26f234ebcf2124a50eb6cbef42dea/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3fc7f131496b42f487d3823dfb71ca39_SeqId_44_ - updating store file list. 2023-02-07 16:56:50,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3fc7f131496b42f487d3823dfb71ca39_SeqId_44_ into d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:50,255 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gpgdkdkflu5a14ef0tmo0ji00n989h1ac8vs7dvjoqun9ug80ekvrgask6apm97m/family1/2107fcaeb95946a7ad665a7398bc53b0 into d1a26f234ebcf2124a50eb6cbef42dea/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3fc7f131496b42f487d3823dfb71ca39_SeqId_44_) 2023-02-07 16:56:50,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__gpgdkdkflu5a14ef0tmo0ji00n989h1ac8vs7dvjoqun9ug80ekvrgask6apm97m/family1/2107fcaeb95946a7ad665a7398bc53b0 2023-02-07 16:56:50,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-07 16:56:50,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-07 16:56:50,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): d1a26f234ebcf2124a50eb6cbef42dea/family1 is initiating minor compaction 2023-02-07 16:56:50,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7435fe50; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-07 16:56:50,261 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of d1a26f234ebcf2124a50eb6cbef42dea/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:50,261 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d2dc50f57a944b15b11045dfe67570c0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/657167bc4a4547cb9516793ac79e2b2e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/ef9722e9c33a4a36b9b23c08e4b4e7b9, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a8fc93552764424f8c24a9565a210096, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/2d03b8c904f74215a3751db6198b5493, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/0dc6b9ff93514f5d8f343216f19d2732, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/8806f15760dc490fb0ec86332c55d9ae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3017f72f1fad496cbf12b2fad789845a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/4ce9041b8a79407c91c410c82b2ca6cb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3fc7f131496b42f487d3823dfb71ca39_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp, totalSize=50.4 K 2023-02-07 16:56:50,261 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting d2dc50f57a944b15b11045dfe67570c0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-07 16:56:50,261 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 657167bc4a4547cb9516793ac79e2b2e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-07 16:56:50,261 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting ef9722e9c33a4a36b9b23c08e4b4e7b9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-07 16:56:50,261 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting a8fc93552764424f8c24a9565a210096, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-07 16:56:50,261 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 2d03b8c904f74215a3751db6198b5493, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-07 16:56:50,261 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 0dc6b9ff93514f5d8f343216f19d2732, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-07 16:56:50,262 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 8806f15760dc490fb0ec86332c55d9ae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-07 16:56:50,262 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 3017f72f1fad496cbf12b2fad789845a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-07 16:56:50,262 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 4ce9041b8a79407c91c410c82b2ca6cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-07 16:56:50,262 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 3fc7f131496b42f487d3823dfb71ca39_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-07 16:56:50,263 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:50,264 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:50,266 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512289a90cbda7b2f4059b3cc46b4d7a63f2b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512289a90cbda7b2f4059b3cc46b4d7a63f2b 2023-02-07 16:56:50,267 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123104e52b03525d47b081d2ce4545b820ae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123104e52b03525d47b081d2ce4545b820ae 2023-02-07 16:56:50,268 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101578f13a078424b509d186c1143284d18 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160101578f13a078424b509d186c1143284d18 2023-02-07 16:56:50,269 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d66f6aff80504cd8bc7242e28cffa70b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103d66f6aff80504cd8bc7242e28cffa70b 2023-02-07 16:56:50,269 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-07 16:56:50,269 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-07 16:56:50,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,270 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,290 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): d1a26f234ebcf2124a50eb6cbef42dea#family1#compaction#61 average throughput is 1.59 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:56:50,310 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/a3ee311219f9474e96fe49ef3f36b253 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a3ee311219f9474e96fe49ef3f36b253 2023-02-07 16:56:50,318 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in d1a26f234ebcf2124a50eb6cbef42dea/family1 of d1a26f234ebcf2124a50eb6cbef42dea into a3ee311219f9474e96fe49ef3f36b253(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:56:50,318 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:50,318 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675789010261; duration=0sec 2023-02-07 16:56:50,318 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:50,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d2dc50f57a944b15b11045dfe67570c0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/657167bc4a4547cb9516793ac79e2b2e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/ef9722e9c33a4a36b9b23c08e4b4e7b9, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a8fc93552764424f8c24a9565a210096, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/2d03b8c904f74215a3751db6198b5493, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/0dc6b9ff93514f5d8f343216f19d2732, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/8806f15760dc490fb0ec86332c55d9ae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3017f72f1fad496cbf12b2fad789845a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/4ce9041b8a79407c91c410c82b2ca6cb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3fc7f131496b42f487d3823dfb71ca39_SeqId_44_] to archive 2023-02-07 16:56:50,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:50,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d2dc50f57a944b15b11045dfe67570c0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d2dc50f57a944b15b11045dfe67570c0 2023-02-07 16:56:50,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/657167bc4a4547cb9516793ac79e2b2e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/657167bc4a4547cb9516793ac79e2b2e 2023-02-07 16:56:50,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/ef9722e9c33a4a36b9b23c08e4b4e7b9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/ef9722e9c33a4a36b9b23c08e4b4e7b9 2023-02-07 16:56:50,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a8fc93552764424f8c24a9565a210096 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a8fc93552764424f8c24a9565a210096 2023-02-07 16:56:50,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/2d03b8c904f74215a3751db6198b5493 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/2d03b8c904f74215a3751db6198b5493 2023-02-07 16:56:50,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/0dc6b9ff93514f5d8f343216f19d2732 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/0dc6b9ff93514f5d8f343216f19d2732 2023-02-07 16:56:50,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/8806f15760dc490fb0ec86332c55d9ae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/8806f15760dc490fb0ec86332c55d9ae 2023-02-07 16:56:50,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3017f72f1fad496cbf12b2fad789845a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3017f72f1fad496cbf12b2fad789845a 2023-02-07 16:56:50,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/4ce9041b8a79407c91c410c82b2ca6cb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/4ce9041b8a79407c91c410c82b2ca6cb 2023-02-07 16:56:50,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3fc7f131496b42f487d3823dfb71ca39_SeqId_44_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/3fc7f131496b42f487d3823dfb71ca39_SeqId_44_ 2023-02-07 16:56:50,733 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205d6ce13af76bb42aea653e9115cb350cf to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205d6ce13af76bb42aea653e9115cb350cf 2023-02-07 16:56:50,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:50,751 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:50,751 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:50,757 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/516aa5716ce8471cb44b818330bc2e8a first=Optional[r00] last=Optional[r2] 2023-02-07 16:56:50,758 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/516aa5716ce8471cb44b818330bc2e8a}] 2023-02-07 16:56:50,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/516aa5716ce8471cb44b818330bc2e8a for inclusion in d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:50,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-07 16:56:50,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:50,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:50,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/516aa5716ce8471cb44b818330bc2e8a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__kvckcmgbpg01kee7uej9s34e6uhlv2bbb31u2fm7i9od8aljsc8u9fjoc1u2q6ki/family1/516aa5716ce8471cb44b818330bc2e8a 2023-02-07 16:56:50,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__kvckcmgbpg01kee7uej9s34e6uhlv2bbb31u2fm7i9od8aljsc8u9fjoc1u2q6ki/family1/516aa5716ce8471cb44b818330bc2e8a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_ 2023-02-07 16:56:50,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__kvckcmgbpg01kee7uej9s34e6uhlv2bbb31u2fm7i9od8aljsc8u9fjoc1u2q6ki/family1/516aa5716ce8471cb44b818330bc2e8a into d1a26f234ebcf2124a50eb6cbef42dea/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_ - updating store file list. 2023-02-07 16:56:50,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_ into d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:50,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__kvckcmgbpg01kee7uej9s34e6uhlv2bbb31u2fm7i9od8aljsc8u9fjoc1u2q6ki/family1/516aa5716ce8471cb44b818330bc2e8a into d1a26f234ebcf2124a50eb6cbef42dea/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_) 2023-02-07 16:56:50,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__kvckcmgbpg01kee7uej9s34e6uhlv2bbb31u2fm7i9od8aljsc8u9fjoc1u2q6ki/family1/516aa5716ce8471cb44b818330bc2e8a 2023-02-07 16:56:50,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-07 16:56:50,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-07 16:56:50,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): d1a26f234ebcf2124a50eb6cbef42dea/family1 is initiating minor compaction (all files) 2023-02-07 16:56:50,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6e123d88; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-07 16:56:50,777 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of d1a26f234ebcf2124a50eb6cbef42dea/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:50,777 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d132261a6da44b9c82e6939bc4a4a88f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a3ee311219f9474e96fe49ef3f36b253, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp, totalSize=390.1 K 2023-02-07 16:56:50,778 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting d132261a6da44b9c82e6939bc4a4a88f, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828694 2023-02-07 16:56:50,778 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting a3ee311219f9474e96fe49ef3f36b253, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228694 2023-02-07 16:56:50,778 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878828694 2023-02-07 16:56:50,779 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:50,780 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:50,782 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130335be0ccd89048a58c3c0336d6ce01c8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151130335be0ccd89048a58c3c0336d6ce01c8 2023-02-07 16:56:50,783 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201987ab742103c4280a3d657674ad06c79 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201987ab742103c4280a3d657674ad06c79 2023-02-07 16:56:50,785 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052a419c3b21e94e419a80af218f2acec3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512052a419c3b21e94e419a80af218f2acec3 2023-02-07 16:56:50,785 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-07 16:56:50,785 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-07 16:56:50,785 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:50,785 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:50,785 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:50,786 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:50,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4580 sec 2023-02-07 16:56:50,795 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): d1a26f234ebcf2124a50eb6cbef42dea#family1#compaction#62 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:56:50,876 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:50,876 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:50,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-07 16:56:50,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:51,289 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-07 16:56:51,291 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-07 16:56:51,291 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-07 16:56:51,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-07 16:56:51,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, REOPEN/MOVE}] 2023-02-07 16:56:51,299 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, REOPEN/MOVE 2023-02-07 16:56:51,300 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:51,300 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675789011300"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789011300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789011300"}]},"ts":"1675789011300"} 2023-02-07 16:56:51,302 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:51,455 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing d1a26f234ebcf2124a50eb6cbef42dea, disabling compactions & flushes 2023-02-07 16:56:51,455 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:51,623 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/.tmp/family1/faf7675be196497b91475b3452961143 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/faf7675be196497b91475b3452961143 2023-02-07 16:56:51,630 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in d1a26f234ebcf2124a50eb6cbef42dea/family1 of d1a26f234ebcf2124a50eb6cbef42dea into faf7675be196497b91475b3452961143(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:56:51,630 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:51,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:51,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:51,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. after waiting 0 ms 2023-02-07 16:56:51,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:51,630 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1675789010777; duration=0sec 2023-02-07 16:56:51,630 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:56:51,631 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d132261a6da44b9c82e6939bc4a4a88f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a3ee311219f9474e96fe49ef3f36b253, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_] to archive 2023-02-07 16:56:51,632 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:51,634 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d132261a6da44b9c82e6939bc4a4a88f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/d132261a6da44b9c82e6939bc4a4a88f 2023-02-07 16:56:51,635 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a3ee311219f9474e96fe49ef3f36b253 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/a3ee311219f9474e96fe49ef3f36b253 2023-02-07 16:56:51,636 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/1fb8245015ef4d0a82584e0a297b29cb_SeqId_47_ 2023-02-07 16:56:51,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-07 16:56:51,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:51,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for d1a26f234ebcf2124a50eb6cbef42dea: Waiting for close lock at 1675789011455Running coprocessor pre-close hooks at 1675789011455Disabling compacts and flushes for region at 1675789011455Disabling writes for close at 1675789011630 (+175 ms)Writing region close event to WAL at 1675789011638 (+8 ms)Running coprocessor post-close hooks at 1675789011641 (+3 ms)Closed at 1675789011641 2023-02-07 16:56:51,642 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: d1a26f234ebcf2124a50eb6cbef42dea to self. 2023-02-07 16:56:51,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,644 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=CLOSED 2023-02-07 16:56:51,644 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675789011644"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789011644"}]},"ts":"1675789011644"} 2023-02-07 16:56:51,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-07 16:56:51,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983 in 343 msec 2023-02-07 16:56:51,647 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=true 2023-02-07 16:56:51,797 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:51,798 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675789011797"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789011797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789011797"}]},"ts":"1675789011797"} 2023-02-07 16:56:51,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:51,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:51,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d1a26f234ebcf2124a50eb6cbef42dea, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:56:51,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:51,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,958 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,959 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:51,959 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:51,960 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1a26f234ebcf2124a50eb6cbef42dea columnFamilyName family1 2023-02-07 16:56:51,965 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/faf7675be196497b91475b3452961143 2023-02-07 16:56:51,965 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(310): Store=d1a26f234ebcf2124a50eb6cbef42dea/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:51,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:51,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened d1a26f234ebcf2124a50eb6cbef42dea; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71565357, jitterRate=0.06640692055225372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:56:51,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for d1a26f234ebcf2124a50eb6cbef42dea: Running coprocessor pre-open hook at 1675789011957Writing region info on filesystem at 1675789011957Initializing all the Stores at 1675789011958 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675789011958Cleaning up temporary data from old regions at 1675789011967 (+9 ms)Cleaning up detritus from prior splits at 1675789011968 (+1 ms)Running coprocessor post-open hooks at 1675789011971 (+3 ms)Region opened successfully at 1675789011971 2023-02-07 16:56:51,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea., pid=47, masterSystemTime=1675789011953 2023-02-07 16:56:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:51,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:51,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:51,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675789011974"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789011974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789011974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789011974"}]},"ts":"1675789011974"} 2023-02-07 16:56:51,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-07 16:56:51,978 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983 in 176 msec 2023-02-07 16:56:51,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-07 16:56:51,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, REOPEN/MOVE in 681 msec 2023-02-07 16:56:51,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-07 16:56:51,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 685 msec 2023-02-07 16:56:51,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1040 sec 2023-02-07 16:56:51,984 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:51,984 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:51,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-07 16:56:51,985 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:51,985 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:51,986 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:51,986 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:51,986 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(278): alter status finished 2023-02-07 16:56:51,987 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:51,988 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:51,989 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:51,990 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789611990 2023-02-07 16:56:51,990 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:51,991 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:56:51,991 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-07 16:56:51,991 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:51,992 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x66655845 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:56:52,044 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@184468de, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:56:52,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:52,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:52,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:52,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:52,045 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:52,876 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dbe18edc38fd4e8b98425cb1392e6a93 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128dbe18edc38fd4e8b98425cb1392e6a93 2023-02-07 16:56:52,877 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:52,890 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:56:52,891 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:54960, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:56:52,897 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:52,898 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:52,898 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:56:52,900 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56536, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:56:52,908 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b72134703e241c9af3200967500c7a1 first=Optional[r05] last=Optional[r8] 2023-02-07 16:56:52,909 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b72134703e241c9af3200967500c7a1}] 2023-02-07 16:56:52,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b72134703e241c9af3200967500c7a1 for inclusion in d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:52,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-07 16:56:52,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:56:52,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for d1a26f234ebcf2124a50eb6cbef42dea: 2023-02-07 16:56:52,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9b72134703e241c9af3200967500c7a1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__segkrc5t23oug9pba1854n41ljn42qq8j35a6afljui4tfl3emgc6bltq7s92j60/family1/9b72134703e241c9af3200967500c7a1 2023-02-07 16:56:52,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__segkrc5t23oug9pba1854n41ljn42qq8j35a6afljui4tfl3emgc6bltq7s92j60/family1/9b72134703e241c9af3200967500c7a1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/47418f2905bd47699208ce5731392ca7_SeqId_53_ 2023-02-07 16:56:52,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__segkrc5t23oug9pba1854n41ljn42qq8j35a6afljui4tfl3emgc6bltq7s92j60/family1/9b72134703e241c9af3200967500c7a1 into d1a26f234ebcf2124a50eb6cbef42dea/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/47418f2905bd47699208ce5731392ca7_SeqId_53_ - updating store file list. 2023-02-07 16:56:52,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/47418f2905bd47699208ce5731392ca7_SeqId_53_ into d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:52,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__segkrc5t23oug9pba1854n41ljn42qq8j35a6afljui4tfl3emgc6bltq7s92j60/family1/9b72134703e241c9af3200967500c7a1 into d1a26f234ebcf2124a50eb6cbef42dea/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/47418f2905bd47699208ce5731392ca7_SeqId_53_) 2023-02-07 16:56:52,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__segkrc5t23oug9pba1854n41ljn42qq8j35a6afljui4tfl3emgc6bltq7s92j60/family1/9b72134703e241c9af3200967500c7a1 2023-02-07 16:56:52,925 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:52,926 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:56:52,927 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205d0ac6d6bbbe446483390e961972b030 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205d0ac6d6bbbe446483390e961972b030 2023-02-07 16:56:52,928 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128f5f2608fb6af4d5c958eefe287dadfd6 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128f5f2608fb6af4d5c958eefe287dadfd6 2023-02-07 16:56:52,929 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-07 16:56:52,929 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-07 16:56:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:52,929 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:52,929 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:52,929 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:52,930 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:52,931 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 942 msec 2023-02-07 16:56:52,976 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:52,976 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:52,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-07 16:56:52,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:53,387 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-07 16:56:53,388 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-07 16:56:53,388 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-07 16:56:53,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-07 16:56:53,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, REOPEN/MOVE}] 2023-02-07 16:56:53,396 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, REOPEN/MOVE 2023-02-07 16:56:53,396 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:53,397 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675789013396"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789013396"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789013396"}]},"ts":"1675789013396"} 2023-02-07 16:56:53,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:53,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing d1a26f234ebcf2124a50eb6cbef42dea, disabling compactions & flushes 2023-02-07 16:56:53,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:53,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:53,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. after waiting 0 ms 2023-02-07 16:56:53,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:53,562 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-07 16:56:53,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:53,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for d1a26f234ebcf2124a50eb6cbef42dea: Waiting for close lock at 1675789013551Running coprocessor pre-close hooks at 1675789013551Disabling compacts and flushes for region at 1675789013551Disabling writes for close at 1675789013551Writing region close event to WAL at 1675789013556 (+5 ms)Running coprocessor post-close hooks at 1675789013563 (+7 ms)Closed at 1675789013563 2023-02-07 16:56:53,563 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: d1a26f234ebcf2124a50eb6cbef42dea to self. 2023-02-07 16:56:53,565 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,566 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=CLOSED 2023-02-07 16:56:53,566 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675789013566"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789013566"}]},"ts":"1675789013566"} 2023-02-07 16:56:53,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-07 16:56:53,571 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983 in 170 msec 2023-02-07 16:56:53,572 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=true 2023-02-07 16:56:53,723 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:53,723 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675789013722"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789013722"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789013722"}]},"ts":"1675789013722"} 2023-02-07 16:56:53,726 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:53,883 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:53,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d1a26f234ebcf2124a50eb6cbef42dea, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:56:53,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:53,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,887 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,889 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:53,889 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1 2023-02-07 16:56:53,890 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1a26f234ebcf2124a50eb6cbef42dea columnFamilyName family1 2023-02-07 16:56:53,899 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/47418f2905bd47699208ce5731392ca7_SeqId_53_ 2023-02-07 16:56:53,905 DEBUG [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/family1/faf7675be196497b91475b3452961143 2023-02-07 16:56:53,905 INFO [StoreOpener-d1a26f234ebcf2124a50eb6cbef42dea-1] regionserver.HStore(310): Store=d1a26f234ebcf2124a50eb6cbef42dea/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:53,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:56:53,912 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened d1a26f234ebcf2124a50eb6cbef42dea; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61124238, jitterRate=-0.08917787671089172}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:56:53,912 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for d1a26f234ebcf2124a50eb6cbef42dea: Running coprocessor pre-open hook at 1675789013885Writing region info on filesystem at 1675789013885Initializing all the Stores at 1675789013886 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675789013887 (+1 ms)Cleaning up temporary data from old regions at 1675789013908 (+21 ms)Cleaning up detritus from prior splits at 1675789013909 (+1 ms)Running coprocessor post-open hooks at 1675789013912 (+3 ms)Region opened successfully at 1675789013912 2023-02-07 16:56:53,913 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea., pid=53, masterSystemTime=1675789013879 2023-02-07 16:56:53,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:53,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:56:53,915 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=d1a26f234ebcf2124a50eb6cbef42dea, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:53,915 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675789013915"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789013915"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789013915"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789013915"}]},"ts":"1675789013915"} 2023-02-07 16:56:53,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-07 16:56:53,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure d1a26f234ebcf2124a50eb6cbef42dea, server=jenkins-hbase12.apache.org,33237,1675788923983 in 190 msec 2023-02-07 16:56:53,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-07 16:56:53,919 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=d1a26f234ebcf2124a50eb6cbef42dea, REOPEN/MOVE in 523 msec 2023-02-07 16:56:53,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-07 16:56:53,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 528 msec 2023-02-07 16:56:53,922 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 944 msec 2023-02-07 16:56:53,922 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:53,922 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:53,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-07 16:56:53,923 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:53,923 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:53,924 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:53,924 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:53,924 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(278): alter status finished 2023-02-07 16:56:53,925 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-07 16:56:53,926 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:53,927 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:53,928 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789613928 2023-02-07 16:56:53,928 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:53,928 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:56:53,929 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-07 16:56:53,929 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:53,929 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x5ba9ad1a to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:56:53,938 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60902c29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:56:53,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:53,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:53,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:53,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:53,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:53,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:53,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:53,939 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-07 16:56:53,939 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-07 16:56:53,939 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:56:53,940 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-07 16:56:53,942 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 15 msec 2023-02-07 16:56:53,988 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=240 (was 251), OpenFileDescriptor=606 (was 609), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=227 (was 280), ProcessCount=172 (was 174), AvailableMemoryMB=2769 (was 2922) 2023-02-07 16:56:53,998 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=240, OpenFileDescriptor=606, MaxFileDescriptor=60000, SystemLoadAverage=227, ProcessCount=172, AvailableMemoryMB=2769 2023-02-07 16:56:53,999 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:53,999 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:54,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-07 16:56:54,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:54,003 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:56:54,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-07 16:56:54,003 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:54,003 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:56:54,003 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:54,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-07 16:56:54,005 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:54,005 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 empty. 2023-02-07 16:56:54,006 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:54,006 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-07 16:56:54,105 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:54,105 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:54,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-07 16:56:54,308 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:54,308 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:54,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-07 16:56:54,416 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-07 16:56:54,419 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 769577360665d8e80f5456b3d3b63372, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:56:54,610 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:54,610 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:54,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-07 16:56:54,831 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:54,831 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 769577360665d8e80f5456b3d3b63372, disabling compactions & flushes 2023-02-07 16:56:54,831 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:54,831 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:54,831 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. after waiting 0 ms 2023-02-07 16:56:54,831 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:54,831 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:54,832 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 769577360665d8e80f5456b3d3b63372: Waiting for close lock at 1675789014831Disabling compacts and flushes for region at 1675789014831Disabling writes for close at 1675789014831Writing region close event to WAL at 1675789014831Closed at 1675789014831 2023-02-07 16:56:54,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:56:54,834 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789014834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789014834"}]},"ts":"1675789014834"} 2023-02-07 16:56:54,836 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:56:54,836 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:56:54,836 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789014836"}]},"ts":"1675789014836"} 2023-02-07 16:56:54,837 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-07 16:56:54,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, ASSIGN}] 2023-02-07 16:56:54,866 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, ASSIGN 2023-02-07 16:56:54,867 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:56:55,019 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:55,020 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789015019"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789015019"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789015019"}]},"ts":"1675789015019"} 2023-02-07 16:56:55,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:56:55,111 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:55,111 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:55,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-07 16:56:55,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:55,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 769577360665d8e80f5456b3d3b63372, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:56:55,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:55,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:56:55,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:55,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:55,181 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:55,182 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:56:55,182 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:56:55,183 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 769577360665d8e80f5456b3d3b63372 columnFamilyName family1 2023-02-07 16:56:55,184 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(310): Store=769577360665d8e80f5456b3d3b63372/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:56:55,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:55,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:55,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:56:55,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:56:55,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 769577360665d8e80f5456b3d3b63372; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74491394, jitterRate=0.11000826954841614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:56:55,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 769577360665d8e80f5456b3d3b63372: Running coprocessor pre-open hook at 1675789015180Writing region info on filesystem at 1675789015180Initializing all the Stores at 1675789015180Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675789015180Cleaning up temporary data from old regions at 1675789015186 (+6 ms)Cleaning up detritus from prior splits at 1675789015186Running coprocessor post-open hooks at 1675789015191 (+5 ms)Region opened successfully at 1675789015191 2023-02-07 16:56:55,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372., pid=57, masterSystemTime=1675789015176 2023-02-07 16:56:55,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:55,193 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:55,194 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:55,194 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789015194"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789015194"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789015194"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789015194"}]},"ts":"1675789015194"} 2023-02-07 16:56:55,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-07 16:56:55,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983 in 172 msec 2023-02-07 16:56:55,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-07 16:56:55,199 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, ASSIGN in 333 msec 2023-02-07 16:56:55,200 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:56:55,200 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789015200"}]},"ts":"1675789015200"} 2023-02-07 16:56:55,203 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-07 16:56:55,212 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:56:55,214 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.2110 sec 2023-02-07 16:56:56,113 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:56,113 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:56,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-07 16:56:56,115 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-07 16:56:56,136 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:56,136 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:56,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:56,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:56,139 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:56:56,139 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:56,139 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:56:56,139 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:56:56,139 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:56,139 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:56,156 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:56,156 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:56,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:56,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:56,156 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:56,156 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:56,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:56,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:56,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:56,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:56,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:56,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:56,157 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:56:56,157 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:56,157 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:56:56,158 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:56,158 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:56,158 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:56,158 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:56:56,158 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-07 16:56:56,285 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:56:56,585 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e01debad608040bf994ca5ad81969bec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e01debad608040bf994ca5ad81969bec 2023-02-07 16:56:56,990 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/e5eb153f322e437ea3601276cbb1ba84 2023-02-07 16:56:56,995 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/e5eb153f322e437ea3601276cbb1ba84 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/e5eb153f322e437ea3601276cbb1ba84 2023-02-07 16:56:57,000 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/e5eb153f322e437ea3601276cbb1ba84, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-07 16:56:57,000 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 842ms, sequenceid=5, compaction requested=false 2023-02-07 16:56:57,001 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:56:57,001 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:57,001 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:57,001 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:57,001 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,001 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:56:57,001 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:56:57,116 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,117 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:57,117 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,117 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:57,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:56:57,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a3ed371[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:57,118 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:56:57,118 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,127 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,127 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:56:57,127 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:56:57,127 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,127 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:57,127 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:57,138 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:56:57,138 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,138 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:57,138 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:56:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:57,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:57,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:57,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:56:57,140 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:56:57,140 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:57,140 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:57,140 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,141 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:57,148 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,148 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:57,148 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:57,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:57,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:57,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:57,149 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:57,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:57,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,150 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,183 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:56:57,188 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:57,188 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:57,189 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:57,189 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-07 16:56:57,188 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:57,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:56:57,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:57,188 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,189 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:57,189 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:57,189 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:57,289 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:57,290 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:57,290 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:57,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:57,294 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:57,294 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:57,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:57,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:57,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,297 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:56:57,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:57,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:56:57,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:56:57,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,297 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,317 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:57,317 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:57,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:57,317 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:57,317 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:57,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:57,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,318 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,318 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:56:57,318 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:57,318 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:56:57,318 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:57,318 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:56:57,318 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:57,318 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:57,318 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:57,318 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:56:57,318 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-07 16:56:57,731 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112834525d1599c64057849d55620d507f9b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112834525d1599c64057849d55620d507f9b 2023-02-07 16:56:58,137 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/7bbc2b09bf1c47d5b5ac6f6bca9a82f2 2023-02-07 16:56:58,142 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/7bbc2b09bf1c47d5b5ac6f6bca9a82f2 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/7bbc2b09bf1c47d5b5ac6f6bca9a82f2 2023-02-07 16:56:58,146 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/7bbc2b09bf1c47d5b5ac6f6bca9a82f2, entries=1, sequenceid=9, filesize=5.0 K 2023-02-07 16:56:58,152 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 834ms, sequenceid=9, compaction requested=false 2023-02-07 16:56:58,152 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:56:58,152 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:58,152 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:58,152 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:58,152 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,152 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:56:58,152 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:56:58,201 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,201 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:58,201 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,201 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:58,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:58,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:56:58,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@45edb55f[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:58,203 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:56:58,203 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,211 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,212 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:56:58,212 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:56:58,212 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:58,212 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,212 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:58,222 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:56:58,222 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,222 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,222 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:56:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:58,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:58,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:58,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:58,224 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:56:58,224 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:56:58,224 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:58,224 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:58,224 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,224 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:58,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:58,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,232 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:58,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:58,233 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:58,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:58,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:58,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:58,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,233 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,243 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:58,243 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:58,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-07 16:56:58,243 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:58,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:58,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:56:58,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:58,243 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:58,243 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,243 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,243 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,244 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:58,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:58,244 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,244 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:58,244 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,244 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:58,344 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:58,344 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:58,344 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:58,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:58,348 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:58,349 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:58,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:58,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:58,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,351 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:56:58,351 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:58,351 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:56:58,351 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:56:58,352 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,352 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:58,359 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:58,359 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:58,359 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:58,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:58,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,360 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,360 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:56:58,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:58,360 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:56:58,360 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:58,360 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:56:58,361 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:58,361 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:58,361 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:58,361 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:56:58,361 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:58,773 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201567e3149e36e4857b616f393bcf93b89 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201567e3149e36e4857b616f393bcf93b89 2023-02-07 16:56:59,178 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/b2b2d9b66a7f4b0e92e693af9cc44061 2023-02-07 16:56:59,184 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/b2b2d9b66a7f4b0e92e693af9cc44061 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/b2b2d9b66a7f4b0e92e693af9cc44061 2023-02-07 16:56:59,189 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/b2b2d9b66a7f4b0e92e693af9cc44061, entries=1, sequenceid=13, filesize=5.0 K 2023-02-07 16:56:59,190 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 829ms, sequenceid=13, compaction requested=true 2023-02-07 16:56:59,190 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:56:59,190 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:59,190 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:56:59,190 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:56:59,190 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,191 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:56:59,191 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:56:59,245 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,246 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:59,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:59,246 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,247 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:56:59,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:59,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:56:59,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@357649c9[Count = 0] remaining members to acquire global barrier 2023-02-07 16:56:59,252 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:56:59,253 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,317 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,317 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:56:59,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:56:59,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:56:59,317 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,318 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:56:59,337 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:56:59,337 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,338 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:59,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:59,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:59,338 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:56:59,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:59,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:59,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:59,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:56:59,340 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:56:59,340 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:56:59,340 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:56:59,340 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:56:59,340 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,340 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:56:59,348 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,348 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,348 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:56:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:56:59,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:59,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:59,349 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:56:59,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:56:59,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,349 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:56:59,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:56:59,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:59,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:56:59,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,359 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-07 16:56:59,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:59,359 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:56:59,359 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,360 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,459 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:56:59,460 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:59,460 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:59,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:56:59,464 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:56:59,464 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:56:59,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:56:59,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:56:59,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,466 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:56:59,466 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:59,466 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:56:59,466 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:56:59,467 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,467 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,485 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,485 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:56:59,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:56:59,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:56:59,485 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:56:59,486 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:56:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:56:59,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,486 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,487 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:56:59,487 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:56:59,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:56:59,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:56:59,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:56:59,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:56:59,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:56:59,488 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:56:59,488 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:56:59,488 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:56:59,901 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120554f269f21ebc4fe1ac3e2d043b916fec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120554f269f21ebc4fe1ac3e2d043b916fec 2023-02-07 16:57:00,306 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/d8d1320ca2004504aecabe87b1a00f01 2023-02-07 16:57:00,311 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/d8d1320ca2004504aecabe87b1a00f01 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d8d1320ca2004504aecabe87b1a00f01 2023-02-07 16:57:00,316 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d8d1320ca2004504aecabe87b1a00f01, entries=1, sequenceid=17, filesize=5.0 K 2023-02-07 16:57:00,317 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 829ms, sequenceid=17, compaction requested=true 2023-02-07 16:57:00,317 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:00,317 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:00,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:57:00,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:57:00,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:57:00,317 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:57:00,416 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,416 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:00,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:00,416 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,417 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:00,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:57:00,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47b2e6cd[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:00,418 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:57:00,418 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,490 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,490 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:57:00,490 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:57:00,490 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:00,490 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,490 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:00,564 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:57:00,564 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:00,564 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,564 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:57:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:00,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:00,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:00,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:00,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:00,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:57:00,574 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:57:00,574 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:00,574 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:00,574 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,574 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:00,617 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,617 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:00,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:00,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,617 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:00,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:00,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:00,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:00,619 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:00,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,623 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:00,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,670 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:00,670 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:00,670 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:00,670 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:00,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:00,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:00,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:00,670 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,671 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,672 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,672 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,672 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:00,672 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:00,672 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:00,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:00,672 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,772 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:00,773 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:00,773 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:00,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:00,780 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:00,781 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:00,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:00,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:00,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,784 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:00,784 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:00,784 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:57:00,784 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:57:00,785 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,785 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,800 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,800 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:00,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:00,801 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:00,801 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,802 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,802 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:57:00,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:00,802 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:57:00,802 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:00,802 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:57:00,802 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:57:00,803 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:00,803 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:00,803 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:57:00,803 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:57:01,217 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228eb743925cb8846ff9df5117489f62ace to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228eb743925cb8846ff9df5117489f62ace 2023-02-07 16:57:01,624 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/bb8549e38b84430e9fac730e6eb8cb53 2023-02-07 16:57:01,633 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/bb8549e38b84430e9fac730e6eb8cb53 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/bb8549e38b84430e9fac730e6eb8cb53 2023-02-07 16:57:01,640 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/bb8549e38b84430e9fac730e6eb8cb53, entries=1, sequenceid=21, filesize=5.0 K 2023-02-07 16:57:01,641 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 838ms, sequenceid=21, compaction requested=true 2023-02-07 16:57:01,641 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:01,641 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:01,641 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:57:01,641 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:57:01,641 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,641 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:57:01,641 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:57:01,685 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,685 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:01,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:01,685 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,685 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:01,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:01,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:01,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:01,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:57:01,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bdb0011[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:01,687 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:57:01,687 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,695 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:57:01,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:57:01,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:01,696 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,696 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:01,706 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,706 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:57:01,706 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:01,706 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:57:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:01,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:01,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:01,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:01,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:57:01,710 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:57:01,710 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:01,710 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:01,710 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,710 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:01,716 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,716 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:01,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:01,716 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,716 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:01,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:01,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:01,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:01,717 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,719 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:01,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,735 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,735 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:01,735 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:01,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:01,735 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,735 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:01,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:01,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:01,736 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:01,735 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:01,736 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:01,735 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:01,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:01,736 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,737 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,737 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,836 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:01,837 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:01,837 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:01,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:01,840 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:01,840 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:01,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:01,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:01,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,842 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:01,842 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:01,842 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:57:01,842 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:57:01,842 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,842 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,853 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:01,853 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:01,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:01,854 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:01,854 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:01,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:01,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,855 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:57:01,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:01,856 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:57:01,856 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:01,856 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:57:01,856 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:57:01,856 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:01,856 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:01,856 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:57:01,856 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:57:02,271 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319d06a717ab444c799718f5b200bad220 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319d06a717ab444c799718f5b200bad220 2023-02-07 16:57:02,676 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/f77f8cccae014e37b525c6c0f1fbb202 2023-02-07 16:57:02,681 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/f77f8cccae014e37b525c6c0f1fbb202 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/f77f8cccae014e37b525c6c0f1fbb202 2023-02-07 16:57:02,685 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/f77f8cccae014e37b525c6c0f1fbb202, entries=1, sequenceid=25, filesize=5.0 K 2023-02-07 16:57:02,686 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 830ms, sequenceid=25, compaction requested=true 2023-02-07 16:57:02,687 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:02,687 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:02,687 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:57:02,687 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:57:02,687 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,687 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:57:02,687 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:57:02,748 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,748 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:02,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:02,748 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,748 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:02,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:02,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:57:02,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23340b78[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:02,750 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:57:02,750 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,758 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,758 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,759 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:57:02,759 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:57:02,759 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:02,759 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,759 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:02,769 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:57:02,769 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:02,769 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:57:02,769 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:02,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:02,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:57:02,771 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:57:02,771 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:02,771 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:02,771 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,771 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:02,823 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,823 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:02,823 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,823 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:02,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:02,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:02,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:02,824 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:02,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:02,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:02,873 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:02,873 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:02,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:02,873 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:02,874 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:02,974 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:02,974 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:02,974 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:02,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:02,981 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:02,981 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:02,982 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:02,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:02,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,985 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:02,985 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:02,985 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:57:02,985 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:57:02,986 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:02,986 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,011 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:03,011 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:03,011 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,011 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:03,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:03,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,012 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,012 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:57:03,013 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,013 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:57:03,013 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:03,013 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:57:03,016 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:57:03,016 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:03,016 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:03,016 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:57:03,016 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:57:03,430 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010114a44c5f73db4499a40b8ce526821b2b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010114a44c5f73db4499a40b8ce526821b2b 2023-02-07 16:57:03,838 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/9f54e0f94bb6461d89327beb77d25bae 2023-02-07 16:57:03,843 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/9f54e0f94bb6461d89327beb77d25bae as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/9f54e0f94bb6461d89327beb77d25bae 2023-02-07 16:57:03,848 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/9f54e0f94bb6461d89327beb77d25bae, entries=1, sequenceid=29, filesize=5.0 K 2023-02-07 16:57:03,849 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 833ms, sequenceid=29, compaction requested=true 2023-02-07 16:57:03,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:03,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:03,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:57:03,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:57:03,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:57:03,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:57:03,861 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,861 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:03,861 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,861 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:03,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:03,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:57:03,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@248b26d6[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:03,863 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:57:03,863 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,874 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,874 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:57:03,874 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:57:03,874 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:03,874 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,874 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:03,958 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:57:03,958 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:03,958 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:57:03,958 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:03,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:03,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:03,961 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:57:03,961 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:57:03,961 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:03,961 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:03,961 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,961 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:03,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:03,969 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:03,970 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:03,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,979 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:03,979 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:03,981 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,981 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,981 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,981 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:03,981 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:03,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:03,981 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:03,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:03,981 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,981 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:03,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:03,982 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:03,982 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:03,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-07 16:57:03,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:03,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:04,082 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:04,082 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:04,082 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:04,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:04,086 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:04,086 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:04,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:04,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:04,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,088 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:04,088 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:04,088 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:57:04,088 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:57:04,089 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,089 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,095 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:04,095 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:04,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:04,096 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,096 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:04,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,096 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,097 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:57:04,097 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,097 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:57:04,097 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:04,097 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:57:04,097 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:57:04,097 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:04,097 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:04,097 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:57:04,097 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:57:04,513 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103639f6a459166444f997219ffc0302c0a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103639f6a459166444f997219ffc0302c0a 2023-02-07 16:57:04,919 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/64a2e087987e44e19907f923fe3b9cd8 2023-02-07 16:57:04,926 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/64a2e087987e44e19907f923fe3b9cd8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/64a2e087987e44e19907f923fe3b9cd8 2023-02-07 16:57:04,932 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/64a2e087987e44e19907f923fe3b9cd8, entries=1, sequenceid=33, filesize=5.0 K 2023-02-07 16:57:04,932 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 835ms, sequenceid=33, compaction requested=true 2023-02-07 16:57:04,933 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:04,933 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:04,933 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:57:04,933 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:57:04,933 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,933 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:57:04,933 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:57:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,955 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:04,956 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,956 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:04,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:04,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:57:04,957 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@745f2804[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:04,957 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:57:04,957 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,969 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,969 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:57:04,969 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:57:04,969 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:04,969 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,969 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:04,979 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:57:04,979 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,979 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:04,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:04,979 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:57:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:04,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:04,982 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:57:04,982 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:57:04,982 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:04,982 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:04,982 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,982 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:04,990 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,990 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,990 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:04,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:04,990 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,992 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:04,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:04,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,000 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,000 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:05,000 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:05,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:05,000 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:05,001 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-07 16:57:05,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:05,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:05,001 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:05,000 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:05,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:05,001 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:05,001 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,002 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:05,002 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,002 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,002 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,102 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:05,102 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:05,102 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:05,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:05,111 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:05,111 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:05,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:05,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:05,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,114 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:05,115 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:05,115 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:57:05,115 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:57:05,115 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,115 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,127 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:05,127 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:05,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:05,127 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,128 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:05,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:05,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,129 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,130 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:57:05,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,130 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:57:05,130 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:05,130 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:57:05,132 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:57:05,132 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:05,132 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:57:05,132 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:05,132 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:57:05,151 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509073e43c4cc23bc47f2baace1124788f67d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509073e43c4cc23bc47f2baace1124788f67d 2023-02-07 16:57:05,557 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/5ac2364a5d5d4e839a3cec80709dfdc1 2023-02-07 16:57:05,567 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/5ac2364a5d5d4e839a3cec80709dfdc1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/5ac2364a5d5d4e839a3cec80709dfdc1 2023-02-07 16:57:05,572 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/5ac2364a5d5d4e839a3cec80709dfdc1, entries=1, sequenceid=37, filesize=5.0 K 2023-02-07 16:57:05,573 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 441ms, sequenceid=37, compaction requested=true 2023-02-07 16:57:05,573 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:05,573 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:05,573 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:57:05,573 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:57:05,573 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,573 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:57:05,573 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:57:05,579 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,579 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:05,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:05,580 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,580 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:05,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:05,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:05,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:57:05,583 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27577516[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:05,583 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:57:05,583 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,590 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,590 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:57:05,590 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:57:05,590 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:05,590 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,590 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:05,600 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:57:05,600 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:05,601 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:57:05,600 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:05,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:05,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:05,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:05,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:05,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:57:05,608 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:57:05,608 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:05,608 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:05,608 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,608 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:05,621 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,622 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:05,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:05,622 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:05,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:05,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:05,624 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:05,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,628 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:05,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,642 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:05,642 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,643 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,643 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,643 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:05,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:05,642 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:05,643 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:05,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:05,643 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:05,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-07 16:57:05,643 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,643 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:05,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:05,644 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:05,643 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:05,744 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:05,744 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:05,744 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:05,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:05,751 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:05,752 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:05,753 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:05,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:05,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,756 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:05,756 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:05,756 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-07 16:57:05,756 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-07 16:57:05,757 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,757 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,769 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:05,769 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:05,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:05,769 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:05,769 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:05,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:05,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,771 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,771 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-07 16:57:05,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:05,771 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-07 16:57:05,771 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:05,771 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-07 16:57:05,771 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:57:05,771 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:05,771 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:05,772 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. started... 2023-02-07 16:57:05,772 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 769577360665d8e80f5456b3d3b63372 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:57:06,196 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120daf7342dc88b41fe938ee56da692f6cb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120daf7342dc88b41fe938ee56da692f6cb 2023-02-07 16:57:06,605 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/c9238f74e33c4a9d846eabfc3a2fe015 2023-02-07 16:57:06,615 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/c9238f74e33c4a9d846eabfc3a2fe015 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/c9238f74e33c4a9d846eabfc3a2fe015 2023-02-07 16:57:06,620 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/c9238f74e33c4a9d846eabfc3a2fe015, entries=1, sequenceid=41, filesize=5.0 K 2023-02-07 16:57:06,620 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 769577360665d8e80f5456b3d3b63372 in 848ms, sequenceid=41, compaction requested=true 2023-02-07 16:57:06,620 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:06,620 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:06,620 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:57:06,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:57:06,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-07 16:57:06,621 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-07 16:57:06,694 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,694 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:06,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:06,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,695 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:06,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:06,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:06,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:06,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-07 16:57:06,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@243bc54f[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:06,697 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-07 16:57:06,697 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,737 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-07 16:57:06,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-07 16:57:06,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:06,738 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,738 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:06,748 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-07 16:57:06,748 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,748 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:06,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:06,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:06,748 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-07 16:57:06,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:06,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:06,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:06,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:06,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-07 16:57:06,758 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-07 16:57:06,758 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:06,758 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:06,758 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,758 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:06,769 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,769 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,769 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:06,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:06,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:06,770 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:06,773 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:06,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,787 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,787 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,787 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,788 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:06,788 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:06,787 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:06,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-07 16:57:06,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:06,788 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,788 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:06,788 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:06,789 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:06,789 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:06,788 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-07 16:57:06,788 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,790 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:06,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:06,889 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:06,890 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:06,890 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:06,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:06,891 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:06,892 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:06,893 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:06,894 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:57:06,894 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789626894 2023-02-07 16:57:06,896 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:57:06,896 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-07 16:57:06,896 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:06,897 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x53e8f964 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:57:06,906 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@221255db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:57:06,906 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,743 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010340c82507ef4e47d486a6c32b63a637ad to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010340c82507ef4e47d486a6c32b63a637ad 2023-02-07 16:57:07,744 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:07,760 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:57:07,761 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:34044, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:57:07,766 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:07,766 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:07,767 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:57:07,768 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:52082, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:57:07,787 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cca653ab52dc4e528e6d29cab1de64f6 first=Optional[r3] last=Optional[r6] 2023-02-07 16:57:07,788 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cca653ab52dc4e528e6d29cab1de64f6}] 2023-02-07 16:57:07,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cca653ab52dc4e528e6d29cab1de64f6 for inclusion in 769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:07,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-07 16:57:07,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:57:07,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:07,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/cca653ab52dc4e528e6d29cab1de64f6 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__91lok5p7c0crtoqaoj7etf8gr94bmgvlhmht35643dglveqej7och804ol1303a3/family1/cca653ab52dc4e528e6d29cab1de64f6 2023-02-07 16:57:07,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__91lok5p7c0crtoqaoj7etf8gr94bmgvlhmht35643dglveqej7och804ol1303a3/family1/cca653ab52dc4e528e6d29cab1de64f6 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_ 2023-02-07 16:57:07,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__91lok5p7c0crtoqaoj7etf8gr94bmgvlhmht35643dglveqej7och804ol1303a3/family1/cca653ab52dc4e528e6d29cab1de64f6 into 769577360665d8e80f5456b3d3b63372/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_ - updating store file list. 2023-02-07 16:57:07,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_ into 769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:07,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__91lok5p7c0crtoqaoj7etf8gr94bmgvlhmht35643dglveqej7och804ol1303a3/family1/cca653ab52dc4e528e6d29cab1de64f6 into 769577360665d8e80f5456b3d3b63372/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_) 2023-02-07 16:57:07,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__91lok5p7c0crtoqaoj7etf8gr94bmgvlhmht35643dglveqej7och804ol1303a3/family1/cca653ab52dc4e528e6d29cab1de64f6 2023-02-07 16:57:07,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-07 16:57:07,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-07 16:57:07,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): 769577360665d8e80f5456b3d3b63372/family1 is initiating minor compaction 2023-02-07 16:57:07,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@eb194d0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:07,806 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 769577360665d8e80f5456b3d3b63372/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:07,807 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/7bbc2b09bf1c47d5b5ac6f6bca9a82f2, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/b2b2d9b66a7f4b0e92e693af9cc44061, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d8d1320ca2004504aecabe87b1a00f01, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/bb8549e38b84430e9fac730e6eb8cb53, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/f77f8cccae014e37b525c6c0f1fbb202, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/9f54e0f94bb6461d89327beb77d25bae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/64a2e087987e44e19907f923fe3b9cd8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/5ac2364a5d5d4e839a3cec80709dfdc1, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/c9238f74e33c4a9d846eabfc3a2fe015, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp, totalSize=50.3 K 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 7bbc2b09bf1c47d5b5ac6f6bca9a82f2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting b2b2d9b66a7f4b0e92e693af9cc44061, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting d8d1320ca2004504aecabe87b1a00f01, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting bb8549e38b84430e9fac730e6eb8cb53, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting f77f8cccae014e37b525c6c0f1fbb202, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 9f54e0f94bb6461d89327beb77d25bae, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 64a2e087987e44e19907f923fe3b9cd8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 5ac2364a5d5d4e839a3cec80709dfdc1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting c9238f74e33c4a9d846eabfc3a2fe015, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-07 16:57:07,807 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-07 16:57:07,809 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:07,810 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:07,811 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228eb743925cb8846ff9df5117489f62ace to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228eb743925cb8846ff9df5117489f62ace 2023-02-07 16:57:07,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319d06a717ab444c799718f5b200bad220 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512319d06a717ab444c799718f5b200bad220 2023-02-07 16:57:07,813 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010114a44c5f73db4499a40b8ce526821b2b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010114a44c5f73db4499a40b8ce526821b2b 2023-02-07 16:57:07,814 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103639f6a459166444f997219ffc0302c0a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103639f6a459166444f997219ffc0302c0a 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-07 16:57:07,814 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,814 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:07,845 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 769577360665d8e80f5456b3d3b63372#family1#compaction#73 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:08,659 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/6c673eea873046178b14c009ac495c23 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/6c673eea873046178b14c009ac495c23 2023-02-07 16:57:08,662 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a275cb41bfc7478eb94ca8a5ee1aed4e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205a275cb41bfc7478eb94ca8a5ee1aed4e 2023-02-07 16:57:08,663 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 769577360665d8e80f5456b3d3b63372/family1 of 769577360665d8e80f5456b3d3b63372 into 6c673eea873046178b14c009ac495c23(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:57:08,663 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:08,663 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:08,663 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675789027806; duration=0sec 2023-02-07 16:57:08,663 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:08,677 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:08,677 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:08,688 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5f9c1ebbd4684bf39bde0db446a555d1 first=Optional[r00] last=Optional[r2] 2023-02-07 16:57:08,689 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5f9c1ebbd4684bf39bde0db446a555d1}] 2023-02-07 16:57:08,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5f9c1ebbd4684bf39bde0db446a555d1 for inclusion in 769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:08,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-07 16:57:08,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:57:08,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:08,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/5f9c1ebbd4684bf39bde0db446a555d1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dapb794j1e1pn2pql4uj9gf2b859jv4a8nrvntltbhcre0id3h7nv588rtnn00n/family1/5f9c1ebbd4684bf39bde0db446a555d1 2023-02-07 16:57:08,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dapb794j1e1pn2pql4uj9gf2b859jv4a8nrvntltbhcre0id3h7nv588rtnn00n/family1/5f9c1ebbd4684bf39bde0db446a555d1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d3c2ed91a96b46df87670781d867f197_SeqId_47_ 2023-02-07 16:57:08,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dapb794j1e1pn2pql4uj9gf2b859jv4a8nrvntltbhcre0id3h7nv588rtnn00n/family1/5f9c1ebbd4684bf39bde0db446a555d1 into 769577360665d8e80f5456b3d3b63372/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d3c2ed91a96b46df87670781d867f197_SeqId_47_ - updating store file list. 2023-02-07 16:57:08,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d3c2ed91a96b46df87670781d867f197_SeqId_47_ into 769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:08,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dapb794j1e1pn2pql4uj9gf2b859jv4a8nrvntltbhcre0id3h7nv588rtnn00n/family1/5f9c1ebbd4684bf39bde0db446a555d1 into 769577360665d8e80f5456b3d3b63372/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d3c2ed91a96b46df87670781d867f197_SeqId_47_) 2023-02-07 16:57:08,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dapb794j1e1pn2pql4uj9gf2b859jv4a8nrvntltbhcre0id3h7nv588rtnn00n/family1/5f9c1ebbd4684bf39bde0db446a555d1 2023-02-07 16:57:08,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-07 16:57:08,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-07 16:57:08,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): 769577360665d8e80f5456b3d3b63372/family1 is initiating minor compaction (all files) 2023-02-07 16:57:08,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@286eba49; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-07 16:57:08,701 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 769577360665d8e80f5456b3d3b63372/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:08,701 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/e5eb153f322e437ea3601276cbb1ba84, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/6c673eea873046178b14c009ac495c23, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d3c2ed91a96b46df87670781d867f197_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp, totalSize=388.1 K 2023-02-07 16:57:08,702 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting e5eb153f322e437ea3601276cbb1ba84, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828694 2023-02-07 16:57:08,702 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 6c673eea873046178b14c009ac495c23, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228694 2023-02-07 16:57:08,702 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting d3c2ed91a96b46df87670781d867f197_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878828694 2023-02-07 16:57:08,703 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:08,703 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:08,704 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e01debad608040bf994ca5ad81969bec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e01debad608040bf994ca5ad81969bec 2023-02-07 16:57:08,706 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201567e3149e36e4857b616f393bcf93b89 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201567e3149e36e4857b616f393bcf93b89 2023-02-07 16:57:08,707 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120554f269f21ebc4fe1ac3e2d043b916fec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120554f269f21ebc4fe1ac3e2d043b916fec 2023-02-07 16:57:08,707 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-07 16:57:08,707 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-07 16:57:08,707 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:08,707 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:08,707 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:57:08,709 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:08,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.8170 sec 2023-02-07 16:57:08,722 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 769577360665d8e80f5456b3d3b63372#family1#compaction#74 average throughput is 17.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:08,754 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/7bbc2b09bf1c47d5b5ac6f6bca9a82f2, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/b2b2d9b66a7f4b0e92e693af9cc44061, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d8d1320ca2004504aecabe87b1a00f01, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/bb8549e38b84430e9fac730e6eb8cb53, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/f77f8cccae014e37b525c6c0f1fbb202, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/9f54e0f94bb6461d89327beb77d25bae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/64a2e087987e44e19907f923fe3b9cd8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/5ac2364a5d5d4e839a3cec80709dfdc1, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/c9238f74e33c4a9d846eabfc3a2fe015, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_] to archive 2023-02-07 16:57:08,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:08,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/7bbc2b09bf1c47d5b5ac6f6bca9a82f2 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/7bbc2b09bf1c47d5b5ac6f6bca9a82f2 2023-02-07 16:57:08,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/b2b2d9b66a7f4b0e92e693af9cc44061 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/b2b2d9b66a7f4b0e92e693af9cc44061 2023-02-07 16:57:08,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d8d1320ca2004504aecabe87b1a00f01 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d8d1320ca2004504aecabe87b1a00f01 2023-02-07 16:57:08,760 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/bb8549e38b84430e9fac730e6eb8cb53 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/bb8549e38b84430e9fac730e6eb8cb53 2023-02-07 16:57:08,761 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/f77f8cccae014e37b525c6c0f1fbb202 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/f77f8cccae014e37b525c6c0f1fbb202 2023-02-07 16:57:08,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/9f54e0f94bb6461d89327beb77d25bae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/9f54e0f94bb6461d89327beb77d25bae 2023-02-07 16:57:08,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/64a2e087987e44e19907f923fe3b9cd8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/64a2e087987e44e19907f923fe3b9cd8 2023-02-07 16:57:08,764 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/5ac2364a5d5d4e839a3cec80709dfdc1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/5ac2364a5d5d4e839a3cec80709dfdc1 2023-02-07 16:57:08,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/c9238f74e33c4a9d846eabfc3a2fe015 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/c9238f74e33c4a9d846eabfc3a2fe015 2023-02-07 16:57:08,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/ac90d9556cfa43e4a41aafdad2fee172_SeqId_44_ 2023-02-07 16:57:08,783 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:08,783 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:08,784 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-07 16:57:08,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:09,195 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-07 16:57:09,196 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-07 16:57:09,196 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-07 16:57:09,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-07 16:57:09,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, REOPEN/MOVE}] 2023-02-07 16:57:09,205 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, REOPEN/MOVE 2023-02-07 16:57:09,206 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:09,206 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789029206"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789029206"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789029206"}]},"ts":"1675789029206"} 2023-02-07 16:57:09,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:09,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:09,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 769577360665d8e80f5456b3d3b63372, disabling compactions & flushes 2023-02-07 16:57:09,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:09,949 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/.tmp/family1/79f1686701ba417a81f97e22270f5db1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/79f1686701ba417a81f97e22270f5db1 2023-02-07 16:57:09,956 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 769577360665d8e80f5456b3d3b63372/family1 of 769577360665d8e80f5456b3d3b63372 into 79f1686701ba417a81f97e22270f5db1(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:09,956 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:09,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:09,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:09,957 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1675789028701; duration=1sec 2023-02-07 16:57:09,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. after waiting 0 ms 2023-02-07 16:57:09,957 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:09,957 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:09,962 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/e5eb153f322e437ea3601276cbb1ba84, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/6c673eea873046178b14c009ac495c23, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d3c2ed91a96b46df87670781d867f197_SeqId_47_] to archive 2023-02-07 16:57:09,963 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:09,965 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/e5eb153f322e437ea3601276cbb1ba84 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/e5eb153f322e437ea3601276cbb1ba84 2023-02-07 16:57:09,967 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/6c673eea873046178b14c009ac495c23 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/6c673eea873046178b14c009ac495c23 2023-02-07 16:57:09,969 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d3c2ed91a96b46df87670781d867f197_SeqId_47_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/d3c2ed91a96b46df87670781d867f197_SeqId_47_ 2023-02-07 16:57:09,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-07 16:57:09,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:09,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 769577360665d8e80f5456b3d3b63372: Waiting for close lock at 1675789029361Running coprocessor pre-close hooks at 1675789029361Disabling compacts and flushes for region at 1675789029361Disabling writes for close at 1675789029957 (+596 ms)Writing region close event to WAL at 1675789029971 (+14 ms)Running coprocessor post-close hooks at 1675789029974 (+3 ms)Closed at 1675789029974 2023-02-07 16:57:09,975 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 769577360665d8e80f5456b3d3b63372 to self. 2023-02-07 16:57:09,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:09,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=CLOSED 2023-02-07 16:57:09,976 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789029976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789029976"}]},"ts":"1675789029976"} 2023-02-07 16:57:09,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-07 16:57:09,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983 in 769 msec 2023-02-07 16:57:09,979 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=true 2023-02-07 16:57:10,129 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:10,130 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789030129"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789030129"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789030129"}]},"ts":"1675789030129"} 2023-02-07 16:57:10,132 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:10,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:10,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 769577360665d8e80f5456b3d3b63372, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:57:10,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:10,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:10,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:10,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:10,291 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:10,292 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:10,292 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:10,293 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 769577360665d8e80f5456b3d3b63372 columnFamilyName family1 2023-02-07 16:57:10,300 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/79f1686701ba417a81f97e22270f5db1 2023-02-07 16:57:10,301 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(310): Store=769577360665d8e80f5456b3d3b63372/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:10,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:10,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:10,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:10,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 769577360665d8e80f5456b3d3b63372; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75496954, jitterRate=0.12499228119850159}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:57:10,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 769577360665d8e80f5456b3d3b63372: Running coprocessor pre-open hook at 1675789030289Writing region info on filesystem at 1675789030289Initializing all the Stores at 1675789030290 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675789030290Cleaning up temporary data from old regions at 1675789030305 (+15 ms)Cleaning up detritus from prior splits at 1675789030306 (+1 ms)Running coprocessor post-open hooks at 1675789030310 (+4 ms)Region opened successfully at 1675789030310 2023-02-07 16:57:10,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372., pid=63, masterSystemTime=1675789030284 2023-02-07 16:57:10,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:10,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:10,314 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:10,314 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789030314"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789030314"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789030314"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789030314"}]},"ts":"1675789030314"} 2023-02-07 16:57:10,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-07 16:57:10,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983 in 184 msec 2023-02-07 16:57:10,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-07 16:57:10,320 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, REOPEN/MOVE in 1.1140 sec 2023-02-07 16:57:10,322 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-07 16:57:10,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1200 sec 2023-02-07 16:57:10,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5390 sec 2023-02-07 16:57:10,325 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:10,325 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:10,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-07 16:57:10,325 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:10,325 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:10,326 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:10,326 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:10,326 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(278): alter status finished 2023-02-07 16:57:10,327 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:10,328 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:10,329 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:10,330 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:57:10,330 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789630330 2023-02-07 16:57:10,330 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:57:10,331 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-07 16:57:10,331 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:10,331 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x53bb42a7 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:57:10,346 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a39880c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:57:10,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:10,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:10,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:10,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:10,346 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:11,176 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511287af95ef1d9c249409a359ba5eb97e13b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511287af95ef1d9c249409a359ba5eb97e13b 2023-02-07 16:57:11,176 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:11,188 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:57:11,189 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:34048, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:57:11,194 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:11,195 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:11,195 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:57:11,197 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:52094, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:57:11,206 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/73469c9b69a0433ead70e4bd7088c11e first=Optional[r05] last=Optional[r8] 2023-02-07 16:57:11,206 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/73469c9b69a0433ead70e4bd7088c11e}] 2023-02-07 16:57:11,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/73469c9b69a0433ead70e4bd7088c11e for inclusion in 769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:11,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-07 16:57:11,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:57:11,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 769577360665d8e80f5456b3d3b63372: 2023-02-07 16:57:11,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/73469c9b69a0433ead70e4bd7088c11e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__oa5sa9devkm0qnjhb8asfsim0tg0eqcsriiqlvg4166n968l0jklagifbbfep1h7/family1/73469c9b69a0433ead70e4bd7088c11e 2023-02-07 16:57:11,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__oa5sa9devkm0qnjhb8asfsim0tg0eqcsriiqlvg4166n968l0jklagifbbfep1h7/family1/73469c9b69a0433ead70e4bd7088c11e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/fe4a14ad9e8b4ec7be8dd723fbccd97b_SeqId_53_ 2023-02-07 16:57:11,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__oa5sa9devkm0qnjhb8asfsim0tg0eqcsriiqlvg4166n968l0jklagifbbfep1h7/family1/73469c9b69a0433ead70e4bd7088c11e into 769577360665d8e80f5456b3d3b63372/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/fe4a14ad9e8b4ec7be8dd723fbccd97b_SeqId_53_ - updating store file list. 2023-02-07 16:57:11,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/fe4a14ad9e8b4ec7be8dd723fbccd97b_SeqId_53_ into 769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:11,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__oa5sa9devkm0qnjhb8asfsim0tg0eqcsriiqlvg4166n968l0jklagifbbfep1h7/family1/73469c9b69a0433ead70e4bd7088c11e into 769577360665d8e80f5456b3d3b63372/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/fe4a14ad9e8b4ec7be8dd723fbccd97b_SeqId_53_) 2023-02-07 16:57:11,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__oa5sa9devkm0qnjhb8asfsim0tg0eqcsriiqlvg4166n968l0jklagifbbfep1h7/family1/73469c9b69a0433ead70e4bd7088c11e 2023-02-07 16:57:11,223 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:11,224 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:11,225 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120daf7342dc88b41fe938ee56da692f6cb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120daf7342dc88b41fe938ee56da692f6cb 2023-02-07 16:57:11,226 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112834525d1599c64057849d55620d507f9b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015112834525d1599c64057849d55620d507f9b 2023-02-07 16:57:11,226 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-07 16:57:11,226 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-07 16:57:11,226 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:11,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:11,227 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:11,227 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:11,227 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:57:11,228 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:11,229 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 900 msec 2023-02-07 16:57:11,279 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:11,279 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:11,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-07 16:57:11,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:11,692 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-07 16:57:11,694 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-07 16:57:11,694 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-07 16:57:11,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-07 16:57:11,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, REOPEN/MOVE}] 2023-02-07 16:57:11,703 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, REOPEN/MOVE 2023-02-07 16:57:11,704 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:11,704 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789031704"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789031704"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789031704"}]},"ts":"1675789031704"} 2023-02-07 16:57:11,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:11,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:11,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 769577360665d8e80f5456b3d3b63372, disabling compactions & flushes 2023-02-07 16:57:11,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:11,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:11,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. after waiting 0 ms 2023-02-07 16:57:11,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:11,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-07 16:57:11,869 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:11,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 769577360665d8e80f5456b3d3b63372: Waiting for close lock at 1675789031858Running coprocessor pre-close hooks at 1675789031858Disabling compacts and flushes for region at 1675789031858Disabling writes for close at 1675789031858Writing region close event to WAL at 1675789031865 (+7 ms)Running coprocessor post-close hooks at 1675789031869 (+4 ms)Closed at 1675789031869 2023-02-07 16:57:11,869 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 769577360665d8e80f5456b3d3b63372 to self. 2023-02-07 16:57:11,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:11,871 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=CLOSED 2023-02-07 16:57:11,871 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789031871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789031871"}]},"ts":"1675789031871"} 2023-02-07 16:57:11,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-07 16:57:11,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983 in 167 msec 2023-02-07 16:57:11,874 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=true 2023-02-07 16:57:12,025 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:12,025 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789032025"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789032025"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789032025"}]},"ts":"1675789032025"} 2023-02-07 16:57:12,029 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:12,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:12,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 769577360665d8e80f5456b3d3b63372, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:57:12,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:12,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:12,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:12,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:12,188 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:12,189 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:12,189 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1 2023-02-07 16:57:12,190 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 769577360665d8e80f5456b3d3b63372 columnFamilyName family1 2023-02-07 16:57:12,197 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/79f1686701ba417a81f97e22270f5db1 2023-02-07 16:57:12,203 DEBUG [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/family1/fe4a14ad9e8b4ec7be8dd723fbccd97b_SeqId_53_ 2023-02-07 16:57:12,203 INFO [StoreOpener-769577360665d8e80f5456b3d3b63372-1] regionserver.HStore(310): Store=769577360665d8e80f5456b3d3b63372/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:12,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:12,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:12,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:57:12,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 769577360665d8e80f5456b3d3b63372; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72041942, jitterRate=0.07350859045982361}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:57:12,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 769577360665d8e80f5456b3d3b63372: Running coprocessor pre-open hook at 1675789032186Writing region info on filesystem at 1675789032186Initializing all the Stores at 1675789032187 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1675789032187Cleaning up temporary data from old regions at 1675789032207 (+20 ms)Cleaning up detritus from prior splits at 1675789032208 (+1 ms)Running coprocessor post-open hooks at 1675789032211 (+3 ms)Region opened successfully at 1675789032211 2023-02-07 16:57:12,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372., pid=69, masterSystemTime=1675789032183 2023-02-07 16:57:12,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:12,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:57:12,214 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=769577360665d8e80f5456b3d3b63372, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:12,214 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675789032214"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789032214"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789032214"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789032214"}]},"ts":"1675789032214"} 2023-02-07 16:57:12,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-07 16:57:12,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 769577360665d8e80f5456b3d3b63372, server=jenkins-hbase12.apache.org,33237,1675788923983 in 187 msec 2023-02-07 16:57:12,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-07 16:57:12,219 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=769577360665d8e80f5456b3d3b63372, REOPEN/MOVE in 515 msec 2023-02-07 16:57:12,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-07 16:57:12,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 523 msec 2023-02-07 16:57:12,223 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 942 msec 2023-02-07 16:57:12,223 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:12,223 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:12,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-07 16:57:12,224 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:12,224 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:12,225 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:12,225 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:12,226 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(278): alter status finished 2023-02-07 16:57:12,226 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-07 16:57:12,228 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:12,228 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:12,229 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:57:12,229 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789632229 2023-02-07 16:57:12,230 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:57:12,230 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-07 16:57:12,230 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:12,231 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x04d66aaf to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:57:12,296 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8b58621, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:57:12,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:12,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:12,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:12,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:12,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:12,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:12,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:12,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-07 16:57:12,298 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-07 16:57:12,298 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:57:12,300 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-07 16:57:12,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 73 msec 2023-02-07 16:57:12,352 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=251 (was 240) - Thread LEAK? -, OpenFileDescriptor=640 (was 606) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 227), ProcessCount=172 (was 172), AvailableMemoryMB=3075 (was 2769) - AvailableMemoryMB LEAK? - 2023-02-07 16:57:12,362 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=251, OpenFileDescriptor=640, MaxFileDescriptor=60000, SystemLoadAverage=214, ProcessCount=172, AvailableMemoryMB=3074 2023-02-07 16:57:12,364 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:12,364 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:12,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-07 16:57:12,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-07 16:57:12,367 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:57:12,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-07 16:57:12,368 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:12,368 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:12,368 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:57:12,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-07 16:57:12,369 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:12,370 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3 empty. 2023-02-07 16:57:12,370 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:12,370 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-07 16:57:12,469 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:12,469 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:12,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-07 16:57:12,670 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:12,670 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:12,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-07 16:57:12,777 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-07 16:57:12,779 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => dc628a14a2d67f617929cc3929c8b2d3, NAME => 'testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:57:12,787 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:12,787 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing dc628a14a2d67f617929cc3929c8b2d3, disabling compactions & flushes 2023-02-07 16:57:12,787 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:12,788 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:12,788 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. after waiting 0 ms 2023-02-07 16:57:12,788 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:12,788 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:12,788 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for dc628a14a2d67f617929cc3929c8b2d3: Waiting for close lock at 1675789032787Disabling compacts and flushes for region at 1675789032787Disabling writes for close at 1675789032788 (+1 ms)Writing region close event to WAL at 1675789032788Closed at 1675789032788 2023-02-07 16:57:12,791 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:57:12,792 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675789032792"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789032792"}]},"ts":"1675789032792"} 2023-02-07 16:57:12,793 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:57:12,794 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:57:12,794 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789032794"}]},"ts":"1675789032794"} 2023-02-07 16:57:12,795 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-07 16:57:12,895 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=dc628a14a2d67f617929cc3929c8b2d3, ASSIGN}] 2023-02-07 16:57:12,898 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=dc628a14a2d67f617929cc3929c8b2d3, ASSIGN 2023-02-07 16:57:12,899 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=dc628a14a2d67f617929cc3929c8b2d3, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:57:12,971 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:12,971 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:12,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-07 16:57:13,050 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=dc628a14a2d67f617929cc3929c8b2d3, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:13,051 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675789033050"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789033050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789033050"}]},"ts":"1675789033050"} 2023-02-07 16:57:13,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure dc628a14a2d67f617929cc3929c8b2d3, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:13,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:13,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => dc628a14a2d67f617929cc3929c8b2d3, NAME => 'testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:57:13,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-07 16:57:13,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-07 16:57:13,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:13,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:13,208 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:13,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:13,210 INFO [StoreOpener-dc628a14a2d67f617929cc3929c8b2d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:13,212 DEBUG [StoreOpener-dc628a14a2d67f617929cc3929c8b2d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1 2023-02-07 16:57:13,212 DEBUG [StoreOpener-dc628a14a2d67f617929cc3929c8b2d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1 2023-02-07 16:57:13,212 INFO [StoreOpener-dc628a14a2d67f617929cc3929c8b2d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc628a14a2d67f617929cc3929c8b2d3 columnFamilyName f1 2023-02-07 16:57:13,214 INFO [StoreOpener-dc628a14a2d67f617929cc3929c8b2d3-1] regionserver.HStore(310): Store=dc628a14a2d67f617929cc3929c8b2d3/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:13,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:13,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:13,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:13,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:57:13,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened dc628a14a2d67f617929cc3929c8b2d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73098459, jitterRate=0.08925192058086395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:57:13,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for dc628a14a2d67f617929cc3929c8b2d3: Running coprocessor pre-open hook at 1675789033209Writing region info on filesystem at 1675789033209Initializing all the Stores at 1675789033210 (+1 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789033210Cleaning up temporary data from old regions at 1675789033216 (+6 ms)Cleaning up detritus from prior splits at 1675789033217 (+1 ms)Running coprocessor post-open hooks at 1675789033222 (+5 ms)Region opened successfully at 1675789033222 2023-02-07 16:57:13,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3., pid=73, masterSystemTime=1675789033203 2023-02-07 16:57:13,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:13,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:13,226 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=dc628a14a2d67f617929cc3929c8b2d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:13,226 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675789033226"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789033226"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789033226"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789033226"}]},"ts":"1675789033226"} 2023-02-07 16:57:13,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-07 16:57:13,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure dc628a14a2d67f617929cc3929c8b2d3, server=jenkins-hbase12.apache.org,33237,1675788923983 in 175 msec 2023-02-07 16:57:13,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-07 16:57:13,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=dc628a14a2d67f617929cc3929c8b2d3, ASSIGN in 334 msec 2023-02-07 16:57:13,232 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:57:13,232 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789033232"}]},"ts":"1675789033232"} 2023-02-07 16:57:13,233 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-07 16:57:13,242 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:57:13,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 877 msec 2023-02-07 16:57:13,473 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:13,473 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:13,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-07 16:57:13,474 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-07 16:57:13,474 DEBUG [Listener at localhost.localdomain/41849] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-07 16:57:13,476 INFO [Listener at localhost.localdomain/41849] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 16:57:13,479 INFO [Listener at localhost.localdomain/41849] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-07 16:57:13,480 INFO [Listener at localhost.localdomain/41849] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-07 16:57:13,480 INFO [Listener at localhost.localdomain/41849] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-07 16:57:13,484 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2744): Flushing dc628a14a2d67f617929cc3929c8b2d3 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-07 16:57:13,895 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207b7bed8e7a4b4474aab0a0a9f878dd097 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207b7bed8e7a4b4474aab0a0a9f878dd097 2023-02-07 16:57:14,287 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-07 16:57:14,303 INFO [Listener at localhost.localdomain/41849] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/.tmp/f1/24815846593b4d45b0c52976f1f89b79 2023-02-07 16:57:14,308 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/.tmp/f1/24815846593b4d45b0c52976f1f89b79 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79 2023-02-07 16:57:14,312 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79, entries=1, sequenceid=5, filesize=4.9 K 2023-02-07 16:57:14,312 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for dc628a14a2d67f617929cc3929c8b2d3 in 828ms, sequenceid=5, compaction requested=false 2023-02-07 16:57:14,313 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2445): Flush status journal for dc628a14a2d67f617929cc3929c8b2d3: 2023-02-07 16:57:14,315 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2744): Flushing dc628a14a2d67f617929cc3929c8b2d3 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-07 16:57:14,730 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207366de24ed48d405cbdf93d6386c55c2d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207366de24ed48d405cbdf93d6386c55c2d 2023-02-07 16:57:15,022 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:57:15,022 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6821b45e to 127.0.0.1:56335 2023-02-07 16:57:15,022 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:15,023 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:57:15,023 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66655845 to 127.0.0.1:56335 2023-02-07 16:57:15,023 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:15,023 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ba9ad1a to 127.0.0.1:56335 2023-02-07 16:57:15,023 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:15,023 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:57:15,023 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53e8f964 to 127.0.0.1:56335 2023-02-07 16:57:15,023 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:15,023 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:57:15,024 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53bb42a7 to 127.0.0.1:56335 2023-02-07 16:57:15,024 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:15,024 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04d66aaf to 127.0.0.1:56335 2023-02-07 16:57:15,024 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:15,138 INFO [Listener at localhost.localdomain/41849] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/.tmp/f1/83cd442517924d07bdcfae0a712f617a 2023-02-07 16:57:15,147 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/.tmp/f1/83cd442517924d07bdcfae0a712f617a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a 2023-02-07 16:57:15,155 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a, entries=1, sequenceid=9, filesize=4.9 K 2023-02-07 16:57:15,157 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for dc628a14a2d67f617929cc3929c8b2d3 in 842ms, sequenceid=9, compaction requested=false 2023-02-07 16:57:15,157 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2445): Flush status journal for dc628a14a2d67f617929cc3929c8b2d3: 2023-02-07 16:57:15,160 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-07 16:57:15,161 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-07 16:57:15,162 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-07 16:57:15,163 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789635163 2023-02-07 16:57:15,163 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:57:15,163 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-07 16:57:15,163 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-07 16:57:15,164 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-07 16:57:15,164 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x1562ef18 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:57:15,190 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31c2f71b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:57:15,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230207 for table='testGetAfterCompaction' and column='f1' 2023-02-07 16:57:15,211 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,211 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,262 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,262 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,313 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,313 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,365 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,365 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,416 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,416 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,468 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,468 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,519 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,520 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,529 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:57:15,570 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,571 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,622 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,622 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,673 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,673 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,724 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,724 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,775 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,775 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,826 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,827 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,878 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,878 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,929 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,930 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,982 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:15,982 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,032 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207388aaacf4e284c0f8cc8d681dba91c0e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207388aaacf4e284c0f8cc8d681dba91c0e 2023-02-07 16:57:16,033 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,033 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,034 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='testGetAfterCompaction' column='f1' 2023-02-07 16:57:16,048 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:57:16,049 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49240, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:57:16,055 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:16,055 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:16,056 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:57:16,058 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:51220, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:57:16,066 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230207/f1/fb2822c9ee3f4c039c3d8496f9c70340 first=Optional[r1] last=Optional[r2] 2023-02-07 16:57:16,067 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230207/f1/fb2822c9ee3f4c039c3d8496f9c70340}] 2023-02-07 16:57:16,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230207/f1/fb2822c9ee3f4c039c3d8496f9c70340 for inclusion in dc628a14a2d67f617929cc3929c8b2d3/f1 2023-02-07 16:57:16,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-07 16:57:16,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:57:16,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for dc628a14a2d67f617929cc3929c8b2d3: 2023-02-07 16:57:16,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230207/f1/fb2822c9ee3f4c039c3d8496f9c70340 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testGetAfterCompaction__fnmum2f0362bft4d35bkv06qt1nb3rm9n01br7omh2dv64k38kr98od5722vq33e/f1/fb2822c9ee3f4c039c3d8496f9c70340 2023-02-07 16:57:16,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testGetAfterCompaction__fnmum2f0362bft4d35bkv06qt1nb3rm9n01br7omh2dv64k38kr98od5722vq33e/f1/fb2822c9ee3f4c039c3d8496f9c70340 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_ 2023-02-07 16:57:16,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testGetAfterCompaction__fnmum2f0362bft4d35bkv06qt1nb3rm9n01br7omh2dv64k38kr98od5722vq33e/f1/fb2822c9ee3f4c039c3d8496f9c70340 into dc628a14a2d67f617929cc3929c8b2d3/f1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_ - updating store file list. 2023-02-07 16:57:16,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_ into dc628a14a2d67f617929cc3929c8b2d3/f1 2023-02-07 16:57:16,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testGetAfterCompaction__fnmum2f0362bft4d35bkv06qt1nb3rm9n01br7omh2dv64k38kr98od5722vq33e/f1/fb2822c9ee3f4c039c3d8496f9c70340 into dc628a14a2d67f617929cc3929c8b2d3/f1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_) 2023-02-07 16:57:16,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testGetAfterCompaction__fnmum2f0362bft4d35bkv06qt1nb3rm9n01br7omh2dv64k38kr98od5722vq33e/f1/fb2822c9ee3f4c039c3d8496f9c70340 2023-02-07 16:57:16,084 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,084 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,084 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(1912): dc628a14a2d67f617929cc3929c8b2d3/f1 is initiating minor compaction 2023-02-07 16:57:16,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@17631db2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:16,085 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of dc628a14a2d67f617929cc3929c8b2d3/f1 in testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:16,085 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/.tmp, totalSize=10.0 K 2023-02-07 16:57:16,085 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 83cd442517924d07bdcfae0a712f617a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-07 16:57:16,085 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting ac591787a9da438b8030e0512a98d554_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-07 16:57:16,087 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='testGetAfterCompaction' column='f1' 2023-02-07 16:57:16,088 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:16,088 DEBUG [Listener at localhost.localdomain/41849] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-07 16:57:16,090 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207366de24ed48d405cbdf93d6386c55c2d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207366de24ed48d405cbdf93d6386c55c2d 2023-02-07 16:57:16,092 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207b7bed8e7a4b4474aab0a0a9f878dd097 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207b7bed8e7a4b4474aab0a0a9f878dd097 2023-02-07 16:57:16,092 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-07 16:57:16,092 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230207' 2023-02-07 16:57:16,093 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230207 for table='testGetAfterCompaction' and column='f1' 2023-02-07 16:57:16,094 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-07 16:57:16,094 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:57:16,096 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-07 16:57:16,096 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49244, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-07 16:57:16,097 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33237] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:16,097 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-07 16:57:16,097 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-07 16:57:16,097 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33237] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-07 16:57:16,098 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=33237] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. because compaction request was cancelled 2023-02-07 16:57:16,098 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 936 msec 2023-02-07 16:57:16,098 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): dc628a14a2d67f617929cc3929c8b2d3#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:16,149 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,149 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,149 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,200 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,201 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,201 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,252 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,253 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,253 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,304 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,304 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,304 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,355 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,356 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,356 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,408 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,408 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,408 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,459 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,459 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,459 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,510 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,511 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,511 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,562 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,562 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,562 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,613 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,613 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,613 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,664 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,665 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,665 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,716 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,717 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,717 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,769 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,769 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,769 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,821 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,822 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,822 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,873 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,873 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,874 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,922 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/.tmp/f1/9e4b086356d74fe0adceacec3cf36d77 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/9e4b086356d74fe0adceacec3cf36d77 2023-02-07 16:57:16,924 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,925 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789035137; access_time=1675789034316; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,925 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/9e4b086356d74fe0adceacec3cf36d77; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675789036911; access_time=1675789036092; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,925 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675789036020; access_time=1675789035209; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-07 16:57:16,929 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in dc628a14a2d67f617929cc3929c8b2d3/f1 of dc628a14a2d67f617929cc3929c8b2d3 into 9e4b086356d74fe0adceacec3cf36d77(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:57:16,929 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for dc628a14a2d67f617929cc3929c8b2d3: 2023-02-07 16:57:16,929 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1675789036084; duration=0sec 2023-02-07 16:57:16,929 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:16,953 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_] to archive 2023-02-07 16:57:16,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:16,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/83cd442517924d07bdcfae0a712f617a 2023-02-07 16:57:16,957 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/ac591787a9da438b8030e0512a98d554_SeqId_12_ 2023-02-07 16:57:16,976 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675789034302; access_time=1675789033486; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:16,976 INFO [Listener at localhost.localdomain/41849] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/9e4b086356d74fe0adceacec3cf36d77; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675789036911; access_time=1675789036092; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-07 16:57:17,098 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:17,098 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:17,098 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-07 16:57:17,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$11(2405): Client=jenkins//136.243.104.168 disable testGetAfterCompaction 2023-02-07 16:57:17,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-07 16:57:17,110 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789037110"}]},"ts":"1675789037110"} 2023-02-07 16:57:17,111 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:17,111 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:17,111 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-07 16:57:17,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-07 16:57:17,212 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:17,212 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:17,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-07 16:57:17,308 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-07 16:57:17,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=dc628a14a2d67f617929cc3929c8b2d3, UNASSIGN}] 2023-02-07 16:57:17,311 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=dc628a14a2d67f617929cc3929c8b2d3, UNASSIGN 2023-02-07 16:57:17,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dc628a14a2d67f617929cc3929c8b2d3, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:17,312 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675789037312"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789037312"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789037312"}]},"ts":"1675789037312"} 2023-02-07 16:57:17,313 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure dc628a14a2d67f617929cc3929c8b2d3, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:17,414 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:17,414 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:17,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-07 16:57:17,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:17,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing dc628a14a2d67f617929cc3929c8b2d3, disabling compactions & flushes 2023-02-07 16:57:17,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:17,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:17,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. after waiting 0 ms 2023-02-07 16:57:17,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:17,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-07 16:57:17,472 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-07 16:57:17,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3. 2023-02-07 16:57:17,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for dc628a14a2d67f617929cc3929c8b2d3: Waiting for close lock at 1675789037465Running coprocessor pre-close hooks at 1675789037465Disabling compacts and flushes for region at 1675789037465Disabling writes for close at 1675789037465Writing region close event to WAL at 1675789037468 (+3 ms)Running coprocessor post-close hooks at 1675789037472 (+4 ms)Closed at 1675789037472 2023-02-07 16:57:17,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:17,474 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dc628a14a2d67f617929cc3929c8b2d3, regionState=CLOSED 2023-02-07 16:57:17,474 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675789037474"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789037474"}]},"ts":"1675789037474"} 2023-02-07 16:57:17,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-07 16:57:17,476 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure dc628a14a2d67f617929cc3929c8b2d3, server=jenkins-hbase12.apache.org,33237,1675788923983 in 162 msec 2023-02-07 16:57:17,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-07 16:57:17,477 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=dc628a14a2d67f617929cc3929c8b2d3, UNASSIGN in 166 msec 2023-02-07 16:57:17,478 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789037478"}]},"ts":"1675789037478"} 2023-02-07 16:57:17,479 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-07 16:57:17,492 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-07 16:57:17,493 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 388 msec 2023-02-07 16:57:17,715 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:17,715 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:17,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-07 16:57:17,716 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-07 16:57:17,717 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:17,717 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:17,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$5(2215): Client=jenkins//136.243.104.168 delete testGetAfterCompaction 2023-02-07 16:57:17,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-07 16:57:17,730 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-07 16:57:17,731 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-07 16:57:17,731 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:17,732 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:17,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-07 16:57:17,734 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:17,737 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1, FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/recovered.edits] 2023-02-07 16:57:17,741 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/24815846593b4d45b0c52976f1f89b79 2023-02-07 16:57:17,743 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/9e4b086356d74fe0adceacec3cf36d77 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/f1/9e4b086356d74fe0adceacec3cf36d77 2023-02-07 16:57:17,746 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/recovered.edits/15.seqid to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3/recovered.edits/15.seqid 2023-02-07 16:57:17,746 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testGetAfterCompaction/dc628a14a2d67f617929cc3929c8b2d3 2023-02-07 16:57:17,746 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-07 16:57:17,747 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-07 16:57:17,747 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-07 16:57:17,751 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207388aaacf4e284c0f8cc8d681dba91c0e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230207388aaacf4e284c0f8cc8d681dba91c0e 2023-02-07 16:57:17,751 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-07 16:57:17,753 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-07 16:57:17,771 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-07 16:57:17,774 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-07 16:57:17,775 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-07 16:57:17,775 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-07 16:57:17,775 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675789037775"}]},"ts":"9223372036854775807"} 2023-02-07 16:57:17,777 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-07 16:57:17,777 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dc628a14a2d67f617929cc3929c8b2d3, NAME => 'testGetAfterCompaction,,1675789032365.dc628a14a2d67f617929cc3929c8b2d3.', STARTKEY => '', ENDKEY => ''}] 2023-02-07 16:57:17,777 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-07 16:57:17,777 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675789037777"}]},"ts":"9223372036854775807"} 2023-02-07 16:57:17,779 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-07 16:57:17,832 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:17,833 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:17,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-07 16:57:17,969 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-07 16:57:17,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 245 msec 2023-02-07 16:57:18,034 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:18,034 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:18,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-07 16:57:18,035 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-07 16:57:18,049 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238 (was 251), OpenFileDescriptor=603 (was 640), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=204 (was 214), ProcessCount=172 (was 172), AvailableMemoryMB=3021 (was 3074) 2023-02-07 16:57:18,064 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=238, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=204, ProcessCount=172, AvailableMemoryMB=3016 2023-02-07 16:57:18,065 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:18,065 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:18,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-07 16:57:18,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-07 16:57:18,069 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:57:18,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-07 16:57:18,069 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:57:18,070 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:18,070 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:18,072 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:18,072 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:18,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-07 16:57:18,072 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:18,072 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1 empty. 2023-02-07 16:57:18,073 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:18,073 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a empty. 2023-02-07 16:57:18,073 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb empty. 2023-02-07 16:57:18,074 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:18,076 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:18,076 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-07 16:57:18,173 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:18,173 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:18,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-07 16:57:18,374 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:18,374 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:18,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-07 16:57:18,497 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-07 16:57:18,499 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3ff1b383efaf25127b1cd74ca8c0cbeb, NAME => 'testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:57:18,499 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => b2de3b9bcecdb49123cc636ca7bf881a, NAME => 'testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:57:18,499 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 4796dff8992ae0816c515956a8e0eae1, NAME => 'testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:57:18,675 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:18,675 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:18,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-07 16:57:18,923 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:18,923 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 4796dff8992ae0816c515956a8e0eae1, disabling compactions & flushes 2023-02-07 16:57:18,923 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:18,923 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:18,923 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. after waiting 0 ms 2023-02-07 16:57:18,923 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:18,923 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:18,923 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 4796dff8992ae0816c515956a8e0eae1: Waiting for close lock at 1675789038923Disabling compacts and flushes for region at 1675789038923Disabling writes for close at 1675789038923Writing region close event to WAL at 1675789038923Closed at 1675789038923 2023-02-07 16:57:18,927 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:18,927 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing b2de3b9bcecdb49123cc636ca7bf881a, disabling compactions & flushes 2023-02-07 16:57:18,927 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:18,927 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:18,927 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. after waiting 0 ms 2023-02-07 16:57:18,927 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:18,927 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:18,927 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for b2de3b9bcecdb49123cc636ca7bf881a: Waiting for close lock at 1675789038927Disabling compacts and flushes for region at 1675789038927Disabling writes for close at 1675789038927Writing region close event to WAL at 1675789038927Closed at 1675789038927 2023-02-07 16:57:18,931 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:18,931 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 3ff1b383efaf25127b1cd74ca8c0cbeb, disabling compactions & flushes 2023-02-07 16:57:18,931 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:18,931 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:18,931 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. after waiting 0 ms 2023-02-07 16:57:18,931 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:18,931 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:18,932 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: Waiting for close lock at 1675789038931Disabling compacts and flushes for region at 1675789038931Disabling writes for close at 1675789038931Writing region close event to WAL at 1675789038931Closed at 1675789038931 2023-02-07 16:57:18,936 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:57:18,938 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789038938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789038938"}]},"ts":"1675789038938"} 2023-02-07 16:57:18,938 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789038938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789038938"}]},"ts":"1675789038938"} 2023-02-07 16:57:18,939 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789038938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789038938"}]},"ts":"1675789038938"} 2023-02-07 16:57:18,940 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-07 16:57:18,941 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:57:18,941 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789038941"}]},"ts":"1675789038941"} 2023-02-07 16:57:18,942 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-07 16:57:19,000 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, ASSIGN}] 2023-02-07 16:57:19,002 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, ASSIGN 2023-02-07 16:57:19,002 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, ASSIGN 2023-02-07 16:57:19,002 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, ASSIGN 2023-02-07 16:57:19,003 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:57:19,003 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:57:19,003 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:57:19,155 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=3ff1b383efaf25127b1cd74ca8c0cbeb, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:19,155 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b2de3b9bcecdb49123cc636ca7bf881a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:19,155 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789039155"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789039155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789039155"}]},"ts":"1675789039155"} 2023-02-07 16:57:19,156 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789039155"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789039155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789039155"}]},"ts":"1675789039155"} 2023-02-07 16:57:19,155 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=4796dff8992ae0816c515956a8e0eae1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:19,156 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789039155"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789039155"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789039155"}]},"ts":"1675789039155"} 2023-02-07 16:57:19,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=82, state=RUNNABLE; OpenRegionProcedure 3ff1b383efaf25127b1cd74ca8c0cbeb, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:19,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=81, state=RUNNABLE; OpenRegionProcedure b2de3b9bcecdb49123cc636ca7bf881a, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:19,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 4796dff8992ae0816c515956a8e0eae1, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:19,177 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:19,177 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:19,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-07 16:57:19,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:19,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b2de3b9bcecdb49123cc636ca7bf881a, NAME => 'testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.', STARTKEY => '1', ENDKEY => '2'} 2023-02-07 16:57:19,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:19,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:19,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:19,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:19,315 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:19,316 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1 2023-02-07 16:57:19,316 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1 2023-02-07 16:57:19,317 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2de3b9bcecdb49123cc636ca7bf881a columnFamilyName family1 2023-02-07 16:57:19,318 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(310): Store=b2de3b9bcecdb49123cc636ca7bf881a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:19,319 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:19,320 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2 2023-02-07 16:57:19,320 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2 2023-02-07 16:57:19,320 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2de3b9bcecdb49123cc636ca7bf881a columnFamilyName family2 2023-02-07 16:57:19,322 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(310): Store=b2de3b9bcecdb49123cc636ca7bf881a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:19,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:19,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:19,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:19,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:19,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:57:19,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened b2de3b9bcecdb49123cc636ca7bf881a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71220886, jitterRate=0.06127390265464783}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:19,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for b2de3b9bcecdb49123cc636ca7bf881a: Running coprocessor pre-open hook at 1675789039314Writing region info on filesystem at 1675789039314Initializing all the Stores at 1675789039315 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789039315Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789039315Cleaning up temporary data from old regions at 1675789039324 (+9 ms)Cleaning up detritus from prior splits at 1675789039324Running coprocessor post-open hooks at 1675789039329 (+5 ms)Region opened successfully at 1675789039329 2023-02-07 16:57:19,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a., pid=84, masterSystemTime=1675789039310 2023-02-07 16:57:19,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:19,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:19,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:19,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3ff1b383efaf25127b1cd74ca8c0cbeb, NAME => 'testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.', STARTKEY => '2', ENDKEY => ''} 2023-02-07 16:57:19,331 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b2de3b9bcecdb49123cc636ca7bf881a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:19,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:19,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:19,331 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789039331"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789039331"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789039331"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789039331"}]},"ts":"1675789039331"} 2023-02-07 16:57:19,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:19,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:19,333 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:19,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=81 2023-02-07 16:57:19,334 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1 2023-02-07 16:57:19,335 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1 2023-02-07 16:57:19,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=81, state=SUCCESS; OpenRegionProcedure b2de3b9bcecdb49123cc636ca7bf881a, server=jenkins-hbase12.apache.org,33237,1675788923983 in 175 msec 2023-02-07 16:57:19,335 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ff1b383efaf25127b1cd74ca8c0cbeb columnFamilyName family1 2023-02-07 16:57:19,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, ASSIGN in 336 msec 2023-02-07 16:57:19,336 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(310): Store=3ff1b383efaf25127b1cd74ca8c0cbeb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:19,336 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:19,338 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2 2023-02-07 16:57:19,338 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2 2023-02-07 16:57:19,338 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ff1b383efaf25127b1cd74ca8c0cbeb columnFamilyName family2 2023-02-07 16:57:19,339 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(310): Store=3ff1b383efaf25127b1cd74ca8c0cbeb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:19,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:19,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:19,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:19,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:19,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:57:19,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 3ff1b383efaf25127b1cd74ca8c0cbeb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69345645, jitterRate=0.033330634236335754}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:19,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: Running coprocessor pre-open hook at 1675789039332Writing region info on filesystem at 1675789039332Initializing all the Stores at 1675789039333 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789039333Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789039333Cleaning up temporary data from old regions at 1675789039341 (+8 ms)Cleaning up detritus from prior splits at 1675789039342 (+1 ms)Running coprocessor post-open hooks at 1675789039345 (+3 ms)Region opened successfully at 1675789039345 2023-02-07 16:57:19,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb., pid=83, masterSystemTime=1675789039310 2023-02-07 16:57:19,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:19,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:19,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:19,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4796dff8992ae0816c515956a8e0eae1, NAME => 'testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.', STARTKEY => '', ENDKEY => '1'} 2023-02-07 16:57:19,348 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=3ff1b383efaf25127b1cd74ca8c0cbeb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:19,348 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789039347"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789039347"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789039347"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789039347"}]},"ts":"1675789039347"} 2023-02-07 16:57:19,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:19,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:19,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:19,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:19,349 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:19,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=82 2023-02-07 16:57:19,350 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=82, state=SUCCESS; OpenRegionProcedure 3ff1b383efaf25127b1cd74ca8c0cbeb, server=jenkins-hbase12.apache.org,33237,1675788923983 in 192 msec 2023-02-07 16:57:19,350 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1 2023-02-07 16:57:19,351 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1 2023-02-07 16:57:19,351 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4796dff8992ae0816c515956a8e0eae1 columnFamilyName family1 2023-02-07 16:57:19,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, ASSIGN in 350 msec 2023-02-07 16:57:19,352 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(310): Store=4796dff8992ae0816c515956a8e0eae1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:19,352 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:19,354 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2 2023-02-07 16:57:19,354 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2 2023-02-07 16:57:19,354 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4796dff8992ae0816c515956a8e0eae1 columnFamilyName family2 2023-02-07 16:57:19,355 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(310): Store=4796dff8992ae0816c515956a8e0eae1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:19,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:19,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:19,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:19,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:19,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:57:19,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 4796dff8992ae0816c515956a8e0eae1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61147027, jitterRate=-0.08883829414844513}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:19,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 4796dff8992ae0816c515956a8e0eae1: Running coprocessor pre-open hook at 1675789039348Writing region info on filesystem at 1675789039348Initializing all the Stores at 1675789039349 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789039349Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789039349Cleaning up temporary data from old regions at 1675789039358 (+9 ms)Cleaning up detritus from prior splits at 1675789039358Running coprocessor post-open hooks at 1675789039370 (+12 ms)Region opened successfully at 1675789039370 2023-02-07 16:57:19,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1., pid=85, masterSystemTime=1675789039310 2023-02-07 16:57:19,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:19,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:19,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=4796dff8992ae0816c515956a8e0eae1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:19,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789039372"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789039372"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789039372"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789039372"}]},"ts":"1675789039372"} 2023-02-07 16:57:19,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-02-07 16:57:19,374 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 4796dff8992ae0816c515956a8e0eae1, server=jenkins-hbase12.apache.org,33237,1675788923983 in 213 msec 2023-02-07 16:57:19,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=80, resume processing ppid=79 2023-02-07 16:57:19,375 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, ASSIGN in 375 msec 2023-02-07 16:57:19,375 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:57:19,375 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789039375"}]},"ts":"1675789039375"} 2023-02-07 16:57:19,376 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-07 16:57:19,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:57:19,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.3880 sec 2023-02-07 16:57:20,178 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:20,178 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:20,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-07 16:57:20,180 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-07 16:57:20,192 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:20,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:20,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:20,195 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:20,195 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:20,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:20,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-07 16:57:20,198 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-07 16:57:20,198 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:20,198 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-07 16:57:20,198 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-07 16:57:20,198 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:20,198 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:20,259 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:20,259 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:20,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:20,259 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:20,260 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:20,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:20,261 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-07 16:57:20,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-07 16:57:20,261 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-07 16:57:20,261 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:20,261 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-07 16:57:20,262 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:20,262 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. started... 2023-02-07 16:57:20,262 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:20,262 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:20,263 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3ff1b383efaf25127b1cd74ca8c0cbeb 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:57:20,262 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. started... 2023-02-07 16:57:20,263 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:20,264 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. started... 2023-02-07 16:57:20,264 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4796dff8992ae0816c515956a8e0eae1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:57:20,263 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:20,264 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b2de3b9bcecdb49123cc636ca7bf881a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:57:20,289 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-07 16:57:20,683 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111 2023-02-07 16:57:20,683 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a 2023-02-07 16:57:20,683 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec 2023-02-07 16:57:20,690 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/8fc0c43777844ec9aa1e3a6fd3bcb170 2023-02-07 16:57:20,701 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207182c5b8f53fb4c3b9453e3373b796e15 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207182c5b8f53fb4c3b9453e3373b796e15 2023-02-07 16:57:21,089 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/45a160c072814a38a272a04e6d834061 2023-02-07 16:57:21,099 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/d60b3c69f6d2478190cc6c8eabd5958a 2023-02-07 16:57:21,106 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/80506a2b80794344a71e5da1214aaa5e 2023-02-07 16:57:21,110 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302076d3b2bf41ce04690b5c15b0f98a90aa8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076d3b2bf41ce04690b5c15b0f98a90aa8 2023-02-07 16:57:21,112 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/8fc0c43777844ec9aa1e3a6fd3bcb170 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/8fc0c43777844ec9aa1e3a6fd3bcb170 2023-02-07 16:57:21,117 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/7688d830bdaa4e118fc5b9ecb03c11dc 2023-02-07 16:57:21,117 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/8fc0c43777844ec9aa1e3a6fd3bcb170, entries=4, sequenceid=5, filesize=5.4 K 2023-02-07 16:57:21,118 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/80506a2b80794344a71e5da1214aaa5e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/80506a2b80794344a71e5da1214aaa5e 2023-02-07 16:57:21,121 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/45a160c072814a38a272a04e6d834061 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/45a160c072814a38a272a04e6d834061 2023-02-07 16:57:21,122 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/80506a2b80794344a71e5da1214aaa5e, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:57:21,123 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3ff1b383efaf25127b1cd74ca8c0cbeb in 861ms, sequenceid=5, compaction requested=false 2023-02-07 16:57:21,124 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:21,124 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:21,124 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:21,127 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/45a160c072814a38a272a04e6d834061, entries=4, sequenceid=5, filesize=5.4 K 2023-02-07 16:57:21,127 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/7688d830bdaa4e118fc5b9ecb03c11dc as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/7688d830bdaa4e118fc5b9ecb03c11dc 2023-02-07 16:57:21,133 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/7688d830bdaa4e118fc5b9ecb03c11dc, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:57:21,134 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4796dff8992ae0816c515956a8e0eae1 in 870ms, sequenceid=5, compaction requested=false 2023-02-07 16:57:21,134 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:21,134 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:21,134 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:21,520 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207603aee7f444f4f1da25f7f7ed6063417 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207603aee7f444f4f1da25f7f7ed6063417 2023-02-07 16:57:21,928 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/2ee4b808c376418396eb230b612c4798 2023-02-07 16:57:21,939 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/d60b3c69f6d2478190cc6c8eabd5958a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/d60b3c69f6d2478190cc6c8eabd5958a 2023-02-07 16:57:21,945 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/d60b3c69f6d2478190cc6c8eabd5958a, entries=4, sequenceid=5, filesize=5.4 K 2023-02-07 16:57:21,946 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/2ee4b808c376418396eb230b612c4798 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/2ee4b808c376418396eb230b612c4798 2023-02-07 16:57:21,950 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/2ee4b808c376418396eb230b612c4798, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:57:21,951 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b2de3b9bcecdb49123cc636ca7bf881a in 1687ms, sequenceid=5, compaction requested=false 2023-02-07 16:57:21,951 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:21,951 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:21,951 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:21,951 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:21,951 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:21,951 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-07 16:57:21,951 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-07 16:57:22,092 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:22,092 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:22,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:22,093 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:22,093 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:22,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:22,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:22,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:22,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:22,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-07 16:57:22,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59fbfa88[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:22,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-07 16:57:22,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:22,167 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:22,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:22,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:22,167 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-07 16:57:22,168 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-07 16:57:22,168 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:22,168 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,168 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:22,210 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,210 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-07 16:57:22,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:22,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:22,210 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:22,211 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-07 16:57:22,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:22,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:22,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:22,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:22,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:22,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:22,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-07 16:57:22,221 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-07 16:57:22,221 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:22,221 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:22,221 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-07 16:57:22,221 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:22,231 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,231 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:22,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,231 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:22,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:22,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:22,232 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:22,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:22,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:22,235 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:22,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:22,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,249 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,249 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:22,250 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:22,250 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-07 16:57:22,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:22,249 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:22,250 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:22,250 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:22,250 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:22,250 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,250 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:22,250 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-07 16:57:22,250 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:22,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:22,251 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:22,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:22,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:22,351 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:22,351 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:22,351 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:22,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:22,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:22,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:22,353 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:22,355 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:22,355 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:22,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:22,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:22,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-07 16:57:22,360 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-07 16:57:22,360 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:22,360 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-07 16:57:22,361 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-07 16:57:22,361 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,361 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:22,367 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:22,367 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:22,368 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:22,368 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:22,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:22,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:22,369 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-07 16:57:22,373 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-07 16:57:22,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-07 16:57:22,373 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-07 16:57:22,373 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:22,373 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-07 16:57:22,375 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:22,375 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. started... 2023-02-07 16:57:22,375 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3ff1b383efaf25127b1cd74ca8c0cbeb 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:57:22,380 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:22,380 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. started... 2023-02-07 16:57:22,380 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4796dff8992ae0816c515956a8e0eae1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:57:22,380 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:22,381 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:22,381 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:22,381 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. started... 2023-02-07 16:57:22,381 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b2de3b9bcecdb49123cc636ca7bf881a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:57:22,804 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78 2023-02-07 16:57:22,804 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a 2023-02-07 16:57:22,804 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb 2023-02-07 16:57:22,974 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:57:23,219 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/7c141e8341e04810aeb6e5bd3c21e0b3 2023-02-07 16:57:23,223 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/92fb8344529940d8b39442ca7bfc53bd 2023-02-07 16:57:23,227 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/7ef6a4deeb6e414e8b89cdac5ec39874 2023-02-07 16:57:23,648 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207d2909d41820746719865704c67e53e9f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207d2909d41820746719865704c67e53e9f 2023-02-07 16:57:23,650 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207bf13b99ac02e4164ac18637e670ea6bc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207bf13b99ac02e4164ac18637e670ea6bc 2023-02-07 16:57:23,651 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207a3ddd97f1746414c82d47a59ae27cd17 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207a3ddd97f1746414c82d47a59ae27cd17 2023-02-07 16:57:24,055 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/8e780a24c43a45ab991b58b69e05c0bc 2023-02-07 16:57:24,059 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/ba63c6e9b5e740b6af1809b59061b847 2023-02-07 16:57:24,060 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/8139e79486ed48a5ac9e3e79b1aec530 2023-02-07 16:57:24,066 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/7c141e8341e04810aeb6e5bd3c21e0b3 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/7c141e8341e04810aeb6e5bd3c21e0b3 2023-02-07 16:57:24,067 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/7ef6a4deeb6e414e8b89cdac5ec39874 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/7ef6a4deeb6e414e8b89cdac5ec39874 2023-02-07 16:57:24,067 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/92fb8344529940d8b39442ca7bfc53bd as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/92fb8344529940d8b39442ca7bfc53bd 2023-02-07 16:57:24,070 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/7c141e8341e04810aeb6e5bd3c21e0b3, entries=4, sequenceid=9, filesize=5.4 K 2023-02-07 16:57:24,071 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/7ef6a4deeb6e414e8b89cdac5ec39874, entries=4, sequenceid=9, filesize=5.4 K 2023-02-07 16:57:24,070 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/92fb8344529940d8b39442ca7bfc53bd, entries=4, sequenceid=9, filesize=5.4 K 2023-02-07 16:57:24,071 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/8e780a24c43a45ab991b58b69e05c0bc as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/8e780a24c43a45ab991b58b69e05c0bc 2023-02-07 16:57:24,071 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/8139e79486ed48a5ac9e3e79b1aec530 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8139e79486ed48a5ac9e3e79b1aec530 2023-02-07 16:57:24,071 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/ba63c6e9b5e740b6af1809b59061b847 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/ba63c6e9b5e740b6af1809b59061b847 2023-02-07 16:57:24,074 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/ba63c6e9b5e740b6af1809b59061b847, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:57:24,074 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8139e79486ed48a5ac9e3e79b1aec530, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:57:24,074 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/8e780a24c43a45ab991b58b69e05c0bc, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:57:24,075 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4796dff8992ae0816c515956a8e0eae1 in 1695ms, sequenceid=9, compaction requested=false 2023-02-07 16:57:24,075 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3ff1b383efaf25127b1cd74ca8c0cbeb in 1700ms, sequenceid=9, compaction requested=false 2023-02-07 16:57:24,075 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:24,075 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b2de3b9bcecdb49123cc636ca7bf881a in 1694ms, sequenceid=9, compaction requested=false 2023-02-07 16:57:24,075 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:24,075 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:24,075 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:24,075 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:24,075 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:24,075 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:24,075 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:24,075 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:24,075 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:24,075 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,075 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-07 16:57:24,075 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-07 16:57:24,157 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,157 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:24,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:24,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:24,158 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:24,158 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:24,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:24,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:24,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:24,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-07 16:57:24,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5469f6bb[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:24,163 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-07 16:57:24,164 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:24,176 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:24,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:24,176 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-07 16:57:24,176 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-07 16:57:24,176 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:24,176 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,176 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:24,188 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-07 16:57:24,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:24,188 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-07 16:57:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:24,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:24,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:24,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:24,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-07 16:57:24,196 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-07 16:57:24,196 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:24,196 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:24,196 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-07 16:57:24,196 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:24,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:24,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:24,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:24,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:24,211 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:24,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:24,214 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:24,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:24,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,228 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:24,228 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:24,228 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:24,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-07 16:57:24,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:24,228 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:24,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:24,228 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:24,229 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:24,229 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:24,229 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,229 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:24,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:24,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:24,229 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:24,230 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:24,230 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,330 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:24,330 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:24,330 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:24,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:24,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:24,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:24,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:24,339 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:24,339 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:24,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:24,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:24,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-07 16:57:24,342 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-07 16:57:24,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:24,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-07 16:57:24,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-07 16:57:24,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,342 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:24,355 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:24,355 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:24,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:24,355 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:24,355 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:24,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:24,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:24,357 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-07 16:57:24,357 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-07 16:57:24,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-07 16:57:24,357 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-07 16:57:24,357 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:24,357 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-07 16:57:24,358 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:24,358 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. started... 2023-02-07 16:57:24,358 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:24,358 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3ff1b383efaf25127b1cd74ca8c0cbeb 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:57:24,358 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. started... 2023-02-07 16:57:24,358 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:24,358 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4796dff8992ae0816c515956a8e0eae1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:57:24,358 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:24,358 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:24,358 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. started... 2023-02-07 16:57:24,359 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b2de3b9bcecdb49123cc636ca7bf881a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:57:24,378 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64 2023-02-07 16:57:24,781 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82 2023-02-07 16:57:24,782 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81 2023-02-07 16:57:24,783 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/6554a0b5611642b38c5d3d014fc4093b 2023-02-07 16:57:24,791 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/f9c14fe73c554c63994d084b3c17bb65 2023-02-07 16:57:25,190 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/e13267b2867d4466844cd3f3f35c8cda 2023-02-07 16:57:25,231 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207921d5dc04d8749079265294060e0017e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207921d5dc04d8749079265294060e0017e 2023-02-07 16:57:25,231 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207769490ffdff84a85bd3a8a2230eb37e2 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207769490ffdff84a85bd3a8a2230eb37e2 2023-02-07 16:57:25,238 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/54c1e42d1e5d4926bbb7e2b5837a7467 2023-02-07 16:57:25,241 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/6554a0b5611642b38c5d3d014fc4093b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/6554a0b5611642b38c5d3d014fc4093b 2023-02-07 16:57:25,244 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/6554a0b5611642b38c5d3d014fc4093b, entries=4, sequenceid=13, filesize=5.4 K 2023-02-07 16:57:25,245 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/54c1e42d1e5d4926bbb7e2b5837a7467 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/54c1e42d1e5d4926bbb7e2b5837a7467 2023-02-07 16:57:25,249 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/54c1e42d1e5d4926bbb7e2b5837a7467, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:57:25,250 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4796dff8992ae0816c515956a8e0eae1 in 892ms, sequenceid=13, compaction requested=true 2023-02-07 16:57:25,250 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:25,251 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:25,251 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:25,637 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/558aebd4298e4050b4a6e60c0079d521 2023-02-07 16:57:25,641 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302079da900a11ac04f14b0da8fd406e551b8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302079da900a11ac04f14b0da8fd406e551b8 2023-02-07 16:57:25,641 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/f9c14fe73c554c63994d084b3c17bb65 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/f9c14fe73c554c63994d084b3c17bb65 2023-02-07 16:57:25,645 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/f9c14fe73c554c63994d084b3c17bb65, entries=4, sequenceid=13, filesize=5.4 K 2023-02-07 16:57:25,645 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/558aebd4298e4050b4a6e60c0079d521 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/558aebd4298e4050b4a6e60c0079d521 2023-02-07 16:57:25,650 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/558aebd4298e4050b4a6e60c0079d521, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:57:25,650 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3ff1b383efaf25127b1cd74ca8c0cbeb in 1292ms, sequenceid=13, compaction requested=true 2023-02-07 16:57:25,650 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:25,651 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:25,651 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:25,738 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-07 16:57:26,046 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/338141da13724c34a459d565dfd6e270 2023-02-07 16:57:26,056 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/e13267b2867d4466844cd3f3f35c8cda as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/e13267b2867d4466844cd3f3f35c8cda 2023-02-07 16:57:26,063 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/e13267b2867d4466844cd3f3f35c8cda, entries=4, sequenceid=13, filesize=5.4 K 2023-02-07 16:57:26,064 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/338141da13724c34a459d565dfd6e270 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/338141da13724c34a459d565dfd6e270 2023-02-07 16:57:26,070 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/338141da13724c34a459d565dfd6e270, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:57:26,071 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b2de3b9bcecdb49123cc636ca7bf881a in 1712ms, sequenceid=13, compaction requested=true 2023-02-07 16:57:26,071 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:26,071 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:26,071 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:26,071 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:26,071 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,072 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-07 16:57:26,072 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-07 16:57:26,115 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:26,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:26,115 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:26,116 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:26,116 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:26,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:26,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:26,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:26,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-07 16:57:26,121 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@488ac6e5[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:26,121 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-07 16:57:26,121 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:26,159 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:26,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:26,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:26,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-07 16:57:26,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-07 16:57:26,160 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:26,160 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,160 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:26,178 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-07 16:57:26,178 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:26,178 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,178 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-07 16:57:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:26,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:26,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:26,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:26,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:26,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:26,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:26,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:26,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-07 16:57:26,185 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-07 16:57:26,185 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:26,185 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:26,185 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-07 16:57:26,185 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:26,199 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,199 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,199 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:26,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:26,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:26,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:26,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:26,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:26,199 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:26,200 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:26,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:26,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:26,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-07 16:57:26,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:26,209 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:26,209 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:26,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:26,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:26,210 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:26,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-07 16:57:26,210 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:26,210 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,210 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:26,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:26,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:26,210 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:26,210 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:26,211 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,311 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:26,311 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:26,311 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:26,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:26,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:26,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:26,314 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:26,317 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:26,318 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:26,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:26,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:26,322 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-07 16:57:26,322 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-07 16:57:26,322 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:26,322 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-07 16:57:26,322 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-07 16:57:26,323 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,323 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:26,336 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:26,336 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:26,336 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:26,336 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:26,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:26,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:26,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:26,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:26,338 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-07 16:57:26,338 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-07 16:57:26,338 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-07 16:57:26,339 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-07 16:57:26,339 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:26,339 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-07 16:57:26,339 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:26,339 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. started... 2023-02-07 16:57:26,339 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:26,339 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:26,340 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3ff1b383efaf25127b1cd74ca8c0cbeb 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:57:26,339 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:26,339 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:26,340 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. started... 2023-02-07 16:57:26,340 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. started... 2023-02-07 16:57:26,340 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b2de3b9bcecdb49123cc636ca7bf881a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:57:26,340 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4796dff8992ae0816c515956a8e0eae1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:57:26,362 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317 2023-02-07 16:57:26,367 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f 2023-02-07 16:57:26,762 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541 2023-02-07 16:57:26,768 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/d3a0a5e38f2749f1829b4d1c359f31e3 2023-02-07 16:57:26,768 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/362996dbff474ce2af5b79928b7220ba 2023-02-07 16:57:26,772 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d 2023-02-07 16:57:27,184 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302076307ca5eb6ff4090b7a31e1ed23ae720 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076307ca5eb6ff4090b7a31e1ed23ae720 2023-02-07 16:57:27,184 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302075cab5282012846daa3af3adecb71cecf to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302075cab5282012846daa3af3adecb71cecf 2023-02-07 16:57:27,187 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302076b9d6e94f3b04f8f908dc3dd91327831 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302076b9d6e94f3b04f8f908dc3dd91327831 2023-02-07 16:57:27,192 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/6ce43f55a3004c2d9cf992f8f280d75b 2023-02-07 16:57:27,196 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d 2023-02-07 16:57:27,201 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d, entries=4, sequenceid=17, filesize=5.4 K 2023-02-07 16:57:27,202 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/6ce43f55a3004c2d9cf992f8f280d75b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/6ce43f55a3004c2d9cf992f8f280d75b 2023-02-07 16:57:27,206 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/6ce43f55a3004c2d9cf992f8f280d75b, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:57:27,207 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b2de3b9bcecdb49123cc636ca7bf881a in 867ms, sequenceid=17, compaction requested=true 2023-02-07 16:57:27,207 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:27,207 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:27,207 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:27,589 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/cb033056a24e462990e5bd567722e775 2023-02-07 16:57:27,589 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/b78f87102b614fb6a0336bc1a1090857 2023-02-07 16:57:27,593 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/362996dbff474ce2af5b79928b7220ba as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/362996dbff474ce2af5b79928b7220ba 2023-02-07 16:57:27,593 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/d3a0a5e38f2749f1829b4d1c359f31e3 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/d3a0a5e38f2749f1829b4d1c359f31e3 2023-02-07 16:57:27,597 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/d3a0a5e38f2749f1829b4d1c359f31e3, entries=4, sequenceid=17, filesize=5.4 K 2023-02-07 16:57:27,597 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/362996dbff474ce2af5b79928b7220ba, entries=4, sequenceid=17, filesize=5.4 K 2023-02-07 16:57:27,597 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/b78f87102b614fb6a0336bc1a1090857 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/b78f87102b614fb6a0336bc1a1090857 2023-02-07 16:57:27,598 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/cb033056a24e462990e5bd567722e775 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/cb033056a24e462990e5bd567722e775 2023-02-07 16:57:27,601 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/cb033056a24e462990e5bd567722e775, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:57:27,602 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/b78f87102b614fb6a0336bc1a1090857, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:57:27,602 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4796dff8992ae0816c515956a8e0eae1 in 1262ms, sequenceid=17, compaction requested=true 2023-02-07 16:57:27,602 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:27,602 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:27,602 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:27,602 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3ff1b383efaf25127b1cd74ca8c0cbeb in 1263ms, sequenceid=17, compaction requested=true 2023-02-07 16:57:27,602 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:27,602 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:27,602 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:27,602 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:27,602 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,602 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-07 16:57:27,603 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-07 16:57:27,655 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,655 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:27,656 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:27,656 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:27,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:27,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:27,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:27,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-07 16:57:27,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32e16306[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:27,659 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-07 16:57:27,659 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:27,691 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:27,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:27,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:27,691 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,691 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-07 16:57:27,692 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-07 16:57:27,692 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:27,692 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:27,704 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-07 16:57:27,704 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,704 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:27,704 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-07 16:57:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:27,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-07 16:57:27,706 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-07 16:57:27,706 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:27,706 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:27,706 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-07 16:57:27,706 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:27,714 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:27,714 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:27,714 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:27,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:27,715 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,715 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:27,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:27,716 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:27,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:27,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,725 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,725 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:27,725 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:27,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-07 16:57:27,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:27,725 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-07 16:57:27,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:27,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:27,725 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:27,725 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:27,725 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:27,725 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:27,726 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:27,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:27,726 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:27,726 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:27,726 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:27,726 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:27,826 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:27,826 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:27,826 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:27,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:27,834 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:27,834 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:27,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1580): Client=jenkins//136.243.104.168 snapshot request for:{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-07 16:57:27,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675789047835 (current time:1675789047835). 2023-02-07 16:57:27,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 16:57:27,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] zookeeper.ReadOnlyZKClient(139): Connect 0x4d9db0a0 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:57:27,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22306500, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:57:27,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:57:27,860 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:57:27,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d9db0a0 to 127.0.0.1:56335 2023-02-07 16:57:27,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:27,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 16:57:27,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-07 16:57:27,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-07 16:57:27,872 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-07 16:57:27,873 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675789647873 2023-02-07 16:57:27,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-07 16:57:27,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1675789047827 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-07 16:57:27,875 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-07 16:57:27,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-07 16:57:27,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-02-07 16:57:27,876 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-07 16:57:27,877 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1675789647877 2023-02-07 16:57:27,879 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:27,879 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 16:57:27,979 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:27,980 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:27,980 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:27,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:27,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:27,984 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 16:57:28,184 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:28,185 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:28,185 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:28,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:28,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:28,186 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 16:57:28,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1675789047827 2023-02-07 16:57:28,286 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1675789047827' 2023-02-07 16:57:28,286 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 16:57:28,286 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1675789047827' starting 'acquire' 2023-02-07 16:57:28,286 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1675789047827', kicking off acquire phase on members. 2023-02-07 16:57:28,287 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,287 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1675789047827 2023-02-07 16:57:28,293 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,293 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 16:57:28,293 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 16:57:28,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 16:57:28,294 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,294 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:28,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1675789047827 2023-02-07 16:57:28,294 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-07 16:57:28,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1675789047827 2023-02-07 16:57:28,294 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1675789047827 from table testCompactionWithHFileLink type FLUSH 2023-02-07 16:57:28,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1675789047827 2023-02-07 16:57:28,297 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1675789047827' with timeout 300000ms 2023-02-07 16:57:28,297 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-07 16:57:28,297 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1675789047827' starting 'acquire' stage 2023-02-07 16:57:28,297 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1675789047827' locally acquired 2023-02-07 16:57:28,297 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (snaptb-1675789047827) in zk 2023-02-07 16:57:28,304 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,304 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1675789047827 2023-02-07 16:57:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 16:57:28,304 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675789047827 2023-02-07 16:57:28,304 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1675789047827' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:28,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675789047827 2023-02-07 16:57:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:28,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'snaptb-1675789047827' on coordinator 2023-02-07 16:57:28,306 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@34c8f068[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:28,306 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1675789047827' starting 'in-barrier' execution. 2023-02-07 16:57:28,306 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1675789047827 2023-02-07 16:57:28,314 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675789047827 2023-02-07 16:57:28,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1675789047827 2023-02-07 16:57:28,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1675789047827 2023-02-07 16:57:28,314 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1675789047827' received 'reached' from coordinator. 2023-02-07 16:57:28,315 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,315 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:28,315 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:28,315 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:28,316 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:28,316 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-07 16:57:28,316 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-07 16:57:28,316 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. started... 2023-02-07 16:57:28,316 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. started... 2023-02-07 16:57:28,316 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. started... 2023-02-07 16:57:28,316 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:28,316 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:28,316 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:28,317 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.' region-info for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,317 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.' region-info for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,317 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.' region-info for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,323 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 16:57:28,323 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 16:57:28,323 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-07 16:57:28,328 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/45a160c072814a38a272a04e6d834061, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/7ef6a4deeb6e414e8b89cdac5ec39874, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/6554a0b5611642b38c5d3d014fc4093b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/362996dbff474ce2af5b79928b7220ba] hfiles 2023-02-07 16:57:28,328 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/8fc0c43777844ec9aa1e3a6fd3bcb170, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/7c141e8341e04810aeb6e5bd3c21e0b3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/f9c14fe73c554c63994d084b3c17bb65, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/d3a0a5e38f2749f1829b4d1c359f31e3] hfiles 2023-02-07 16:57:28,328 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/8fc0c43777844ec9aa1e3a6fd3bcb170 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,328 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/d60b3c69f6d2478190cc6c8eabd5958a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/92fb8344529940d8b39442ca7bfc53bd, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/e13267b2867d4466844cd3f3f35c8cda, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d] hfiles 2023-02-07 16:57:28,328 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/d60b3c69f6d2478190cc6c8eabd5958a for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,328 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/45a160c072814a38a272a04e6d834061 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,451 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-07 16:57:28,451 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:57:28,451 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1562ef18 to 127.0.0.1:56335 2023-02-07 16:57:28,451 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/7c141e8341e04810aeb6e5bd3c21e0b3 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/7ef6a4deeb6e414e8b89cdac5ec39874 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/92fb8344529940d8b39442ca7bfc53bd for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/6554a0b5611642b38c5d3d014fc4093b for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/f9c14fe73c554c63994d084b3c17bb65 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/362996dbff474ce2af5b79928b7220ba for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/e13267b2867d4466844cd3f3f35c8cda for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/d3a0a5e38f2749f1829b4d1c359f31e3 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/7688d830bdaa4e118fc5b9ecb03c11dc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/ba63c6e9b5e740b6af1809b59061b847, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/54c1e42d1e5d4926bbb7e2b5837a7467, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/cb033056a24e462990e5bd567722e775] hfiles 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/80506a2b80794344a71e5da1214aaa5e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/8e780a24c43a45ab991b58b69e05c0bc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/558aebd4298e4050b4a6e60c0079d521, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/b78f87102b614fb6a0336bc1a1090857] hfiles 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/80506a2b80794344a71e5da1214aaa5e for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/7688d830bdaa4e118fc5b9ecb03c11dc for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/8e780a24c43a45ab991b58b69e05c0bc for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/2ee4b808c376418396eb230b612c4798, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8139e79486ed48a5ac9e3e79b1aec530, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/338141da13724c34a459d565dfd6e270, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/6ce43f55a3004c2d9cf992f8f280d75b] hfiles 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/558aebd4298e4050b4a6e60c0079d521 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/ba63c6e9b5e740b6af1809b59061b847 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/b78f87102b614fb6a0336bc1a1090857 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/2ee4b808c376418396eb230b612c4798 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,452 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/54c1e42d1e5d4926bbb7e2b5837a7467 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,453 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8139e79486ed48a5ac9e3e79b1aec530 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,453 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/cb033056a24e462990e5bd567722e775 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,453 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/338141da13724c34a459d565dfd6e270 for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,453 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/6ce43f55a3004c2d9cf992f8f280d75b for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,486 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:28,486 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:28,486 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:28,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:28,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:28,487 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 16:57:28,863 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. completed. 2023-02-07 16:57:28,863 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:28,863 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. completed. 2023-02-07 16:57:28,863 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:28,863 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-07 16:57:28,863 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-07 16:57:28,866 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. completed. 2023-02-07 16:57:28,866 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:28,866 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-07 16:57:28,866 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-07 16:57:28,866 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,867 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1675789047827' locally completed 2023-02-07 16:57:28,867 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1675789047827' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:28,872 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1675789047827' has notified controller of completion 2023-02-07 16:57:28,872 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:28,872 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1675789047827' completed. 2023-02-07 16:57:28,872 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 16:57:28,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:28,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675789047827 2023-02-07 16:57:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:28,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675789047827 2023-02-07 16:57:28,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1675789047827' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:28,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'snaptb-1675789047827', counting down latch. Waiting for 0 more 2023-02-07 16:57:28,877 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1675789047827' execution completed 2023-02-07 16:57:28,877 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:28,877 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:28,877 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1675789047827 2023-02-07 16:57:28,877 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1675789047827including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-07 16:57:28,883 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,883 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:28,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-07 16:57:28,883 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 16:57:28,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 16:57:28,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 16:57:28,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:28,884 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675789047827 2023-02-07 16:57:28,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:28,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675789047827 2023-02-07 16:57:28,886 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:28,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675789047827 2023-02-07 16:57:28,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,893 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-07 16:57:28,893 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,893 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675789047827 2023-02-07 16:57:28,893 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:28,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1675789047827 because node does not exist (not an error) 2023-02-07 16:57:28,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-07 16:57:28,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-07 16:57:28,893 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-07 16:57:28,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1675789047827 2023-02-07 16:57:28,893 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675789047827 2023-02-07 16:57:28,893 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-07 16:57:28,893 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675789047827/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:28,894 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675789047827 2023-02-07 16:57:28,894 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675789047827 2023-02-07 16:57:28,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1675789047827 2023-02-07 16:57:28,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-07 16:57:28,894 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675789047827 2023-02-07 16:57:28,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-07 16:57:28,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-07 16:57:28,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317] mob files 2023-02-07 16:57:28,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81 2023-02-07 16:57:28,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb 2023-02-07 16:57:28,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f 2023-02-07 16:57:28,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111 2023-02-07 16:57:28,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a 2023-02-07 16:57:28,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec 2023-02-07 16:57:28,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207603aee7f444f4f1da25f7f7ed6063417, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302076b9d6e94f3b04f8f908dc3dd91327831, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302079da900a11ac04f14b0da8fd406e551b8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207bf13b99ac02e4164ac18637e670ea6bc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207182c5b8f53fb4c3b9453e3373b796e15, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302075cab5282012846daa3af3adecb71cecf, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207921d5dc04d8749079265294060e0017e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207d2909d41820746719865704c67e53e9f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076307ca5eb6ff4090b7a31e1ed23ae720, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076d3b2bf41ce04690b5c15b0f98a90aa8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207769490ffdff84a85bd3a8a2230eb37e2, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207a3ddd97f1746414c82d47a59ae27cd17] mob files 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207603aee7f444f4f1da25f7f7ed6063417 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302076b9d6e94f3b04f8f908dc3dd91327831 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302079da900a11ac04f14b0da8fd406e551b8 2023-02-07 16:57:28,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207bf13b99ac02e4164ac18637e670ea6bc 2023-02-07 16:57:28,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207182c5b8f53fb4c3b9453e3373b796e15 2023-02-07 16:57:28,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302075cab5282012846daa3af3adecb71cecf 2023-02-07 16:57:28,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207921d5dc04d8749079265294060e0017e 2023-02-07 16:57:28,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207d2909d41820746719865704c67e53e9f 2023-02-07 16:57:28,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076307ca5eb6ff4090b7a31e1ed23ae720 2023-02-07 16:57:28,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076d3b2bf41ce04690b5c15b0f98a90aa8 2023-02-07 16:57:28,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207769490ffdff84a85bd3a8a2230eb37e2 2023-02-07 16:57:28,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207a3ddd97f1746414c82d47a59ae27cd17 2023-02-07 16:57:28,987 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:28,988 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:28,988 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:28,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:28,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:28,989 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-07 16:57:29,301 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1675789047827 2023-02-07 16:57:29,304 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp/snaptb-1675789047827 2023-02-07 16:57:29,749 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp/snaptb-1675789047827 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/snaptb-1675789047827 2023-02-07 16:57:29,989 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:29,989 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:29,989 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:29,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:29,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:29,990 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-07 16:57:30,170 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1675789047827 of table testCompactionWithHFileLink completed 2023-02-07 16:57:30,170 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp/snaptb-1675789047827 2023-02-07 16:57:30,171 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp/snaptb-1675789047827 2023-02-07 16:57:30,171 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1675789047827 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675789047874Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1675789049301 (+1427 ms)Consolidate snapshot: snaptb-1675789047827 at 1675789049301Loading Region manifests for snaptb-1675789047827 at 1675789049302 (+1 ms)Writing data manifest for snaptb-1675789047827 at 1675789049313 (+11 ms)Verifying snapshot: snaptb-1675789047827 at 1675789049724 (+411 ms)Snapshot snaptb-1675789047827 of table testCompactionWithHFileLink completed at 1675789050170 (+446 ms) 2023-02-07 16:57:30,173 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-07 16:57:30,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 2.2990 sec 2023-02-07 16:57:31,991 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:31,991 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:31,991 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:31,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:31,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 16:57:32,031 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:32,031 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:32,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:32,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:32,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-07 16:57:32,033 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-07 16:57:32,033 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:32,033 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-07 16:57:32,033 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-07 16:57:32,034 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:32,034 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:32,040 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:32,040 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:32,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:32,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:32,040 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:32,041 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:32,041 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:32,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:32,041 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-07 16:57:32,042 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-07 16:57:32,042 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-07 16:57:32,042 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:32,042 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-07 16:57:32,042 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:32,042 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:32,042 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. started... 2023-02-07 16:57:32,042 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. started... 2023-02-07 16:57:32,042 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:32,042 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 3ff1b383efaf25127b1cd74ca8c0cbeb 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:57:32,042 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:32,042 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 4796dff8992ae0816c515956a8e0eae1 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:57:32,042 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:32,042 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. started... 2023-02-07 16:57:32,042 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing b2de3b9bcecdb49123cc636ca7bf881a 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:57:32,457 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/0411f29f5c1149f1a0a7235f13671c49 2023-02-07 16:57:32,461 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0411f29f5c1149f1a0a7235f13671c49 2023-02-07 16:57:32,861 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/d33b0817023c401e90ff57ec464a602a 2023-02-07 16:57:32,862 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/5e806afdb21845fab62f2b4f067205b5 2023-02-07 16:57:32,871 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d33b0817023c401e90ff57ec464a602a 2023-02-07 16:57:32,871 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e806afdb21845fab62f2b4f067205b5 2023-02-07 16:57:33,282 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/2e6080a673ff4121b156ccbead02665a 2023-02-07 16:57:33,288 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e6080a673ff4121b156ccbead02665a 2023-02-07 16:57:33,289 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/0411f29f5c1149f1a0a7235f13671c49 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/0411f29f5c1149f1a0a7235f13671c49 2023-02-07 16:57:33,294 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0411f29f5c1149f1a0a7235f13671c49 2023-02-07 16:57:33,294 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/0411f29f5c1149f1a0a7235f13671c49, entries=3, sequenceid=24, filesize=5.0 K 2023-02-07 16:57:33,295 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/2e6080a673ff4121b156ccbead02665a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/2e6080a673ff4121b156ccbead02665a 2023-02-07 16:57:33,297 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/8e2747378b5a4affb61d065f065696c0 2023-02-07 16:57:33,299 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2e6080a673ff4121b156ccbead02665a 2023-02-07 16:57:33,299 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/2e6080a673ff4121b156ccbead02665a, entries=1, sequenceid=24, filesize=5.0 K 2023-02-07 16:57:33,299 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3ff1b383efaf25127b1cd74ca8c0cbeb in 1257ms, sequenceid=24, compaction requested=true 2023-02-07 16:57:33,299 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:33,299 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:33,299 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e2747378b5a4affb61d065f065696c0 2023-02-07 16:57:33,299 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:33,300 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/5e806afdb21845fab62f2b4f067205b5 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/5e806afdb21845fab62f2b4f067205b5 2023-02-07 16:57:33,303 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e806afdb21845fab62f2b4f067205b5 2023-02-07 16:57:33,303 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/5e806afdb21845fab62f2b4f067205b5, entries=3, sequenceid=24, filesize=5.0 K 2023-02-07 16:57:33,304 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/8e2747378b5a4affb61d065f065696c0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8e2747378b5a4affb61d065f065696c0 2023-02-07 16:57:33,307 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8e2747378b5a4affb61d065f065696c0 2023-02-07 16:57:33,307 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8e2747378b5a4affb61d065f065696c0, entries=1, sequenceid=24, filesize=5.0 K 2023-02-07 16:57:33,308 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b2de3b9bcecdb49123cc636ca7bf881a in 1266ms, sequenceid=24, compaction requested=true 2023-02-07 16:57:33,308 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:33,308 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:33,308 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:33,696 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/6ce7240673344fd9be2660ca981dc48b 2023-02-07 16:57:33,705 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ce7240673344fd9be2660ca981dc48b 2023-02-07 16:57:33,707 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/d33b0817023c401e90ff57ec464a602a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/d33b0817023c401e90ff57ec464a602a 2023-02-07 16:57:33,714 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d33b0817023c401e90ff57ec464a602a 2023-02-07 16:57:33,714 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/d33b0817023c401e90ff57ec464a602a, entries=3, sequenceid=24, filesize=5.0 K 2023-02-07 16:57:33,716 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/6ce7240673344fd9be2660ca981dc48b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/6ce7240673344fd9be2660ca981dc48b 2023-02-07 16:57:33,722 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6ce7240673344fd9be2660ca981dc48b 2023-02-07 16:57:33,722 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/6ce7240673344fd9be2660ca981dc48b, entries=1, sequenceid=24, filesize=5.0 K 2023-02-07 16:57:33,723 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4796dff8992ae0816c515956a8e0eae1 in 1681ms, sequenceid=24, compaction requested=true 2023-02-07 16:57:33,723 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:33,723 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:33,723 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:33,723 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:33,723 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,723 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-07 16:57:33,723 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-07 16:57:33,788 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:33,788 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:33,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:33,789 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:33,789 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:33,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:33,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:33,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:33,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:33,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-07 16:57:33,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f0f0464[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:33,792 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-07 16:57:33,792 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:33,809 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:33,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:33,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:33,809 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-07 16:57:33,809 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-07 16:57:33,809 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:33,810 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,810 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:33,819 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-07 16:57:33,819 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:33,819 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-07 16:57:33,819 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:33,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:33,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:33,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:33,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:33,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-07 16:57:33,822 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-07 16:57:33,823 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:33,823 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:33,823 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-07 16:57:33,823 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:33,830 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:33,830 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:33,830 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:33,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:33,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:33,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:33,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:33,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:33,830 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:33,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:33,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:33,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:33,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:33,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:33,831 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:33,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:33,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-07 16:57:33,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,840 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,840 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:33,840 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:33,840 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:33,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-07 16:57:33,840 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:33,840 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-07 16:57:33,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:33,840 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-07 16:57:33,840 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:33,840 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:33,841 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:33,841 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:33,841 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:33,841 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-07 16:57:33,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:33,841 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-07 16:57:33,941 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:33,941 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:33,941 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:33,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:33,942 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:33,943 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 is initiating major compaction (all files) 2023-02-07 16:57:33,943 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:57:33,943 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:57:33,943 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 in testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:33,943 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/8fc0c43777844ec9aa1e3a6fd3bcb170, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/7c141e8341e04810aeb6e5bd3c21e0b3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/f9c14fe73c554c63994d084b3c17bb65, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/d3a0a5e38f2749f1829b4d1c359f31e3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/0411f29f5c1149f1a0a7235f13671c49] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp, totalSize=26.7 K 2023-02-07 16:57:33,944 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 8fc0c43777844ec9aa1e3a6fd3bcb170, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040193 2023-02-07 16:57:33,944 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 7c141e8341e04810aeb6e5bd3c21e0b3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:33,944 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting f9c14fe73c554c63994d084b3c17bb65, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044336 2023-02-07 16:57:33,945 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting d3a0a5e38f2749f1829b4d1c359f31e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046314 2023-02-07 16:57:33,945 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 0411f29f5c1149f1a0a7235f13671c49, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-07 16:57:33,962 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 3ff1b383efaf25127b1cd74ca8c0cbeb#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:34,371 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230207aa106e1939e64898b1af08832bef9fee_del 2023-02-07 16:57:34,371 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207aa106e1939e64898b1af08832bef9fee_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207aa106e1939e64898b1af08832bef9fee_del 2023-02-07 16:57:35,191 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e923fa4990b84591815f4cf2a207f2fb 2023-02-07 16:57:35,193 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/e923fa4990b84591815f4cf2a207f2fb as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/e923fa4990b84591815f4cf2a207f2fb 2023-02-07 16:57:35,200 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e923fa4990b84591815f4cf2a207f2fb 2023-02-07 16:57:35,201 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 of 3ff1b383efaf25127b1cd74ca8c0cbeb into e923fa4990b84591815f4cf2a207f2fb(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:35,201 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:35,202 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:35,202 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 3ff1b383efaf25127b1cd74ca8c0cbeb/family2 is initiating major compaction (all files) 2023-02-07 16:57:35,202 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:57:35,202 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:57:35,203 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 3ff1b383efaf25127b1cd74ca8c0cbeb/family2 in testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:35,203 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/80506a2b80794344a71e5da1214aaa5e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/8e780a24c43a45ab991b58b69e05c0bc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/558aebd4298e4050b4a6e60c0079d521, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/b78f87102b614fb6a0336bc1a1090857, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/2e6080a673ff4121b156ccbead02665a] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp, totalSize=25.4 K 2023-02-07 16:57:35,203 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 80506a2b80794344a71e5da1214aaa5e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040193 2023-02-07 16:57:35,204 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 8e780a24c43a45ab991b58b69e05c0bc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:35,205 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 558aebd4298e4050b4a6e60c0079d521, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044336 2023-02-07 16:57:35,205 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting b78f87102b614fb6a0336bc1a1090857, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046314 2023-02-07 16:57:35,206 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 2e6080a673ff4121b156ccbead02665a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-07 16:57:35,220 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 3ff1b383efaf25127b1cd74ca8c0cbeb#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:35,252 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/8fc0c43777844ec9aa1e3a6fd3bcb170, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/7c141e8341e04810aeb6e5bd3c21e0b3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/f9c14fe73c554c63994d084b3c17bb65, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/d3a0a5e38f2749f1829b4d1c359f31e3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/0411f29f5c1149f1a0a7235f13671c49] to archive 2023-02-07 16:57:35,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:35,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/8fc0c43777844ec9aa1e3a6fd3bcb170 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/8fc0c43777844ec9aa1e3a6fd3bcb170 2023-02-07 16:57:35,260 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/7c141e8341e04810aeb6e5bd3c21e0b3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/7c141e8341e04810aeb6e5bd3c21e0b3 2023-02-07 16:57:35,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/f9c14fe73c554c63994d084b3c17bb65 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/f9c14fe73c554c63994d084b3c17bb65 2023-02-07 16:57:35,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/d3a0a5e38f2749f1829b4d1c359f31e3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/d3a0a5e38f2749f1829b4d1c359f31e3 2023-02-07 16:57:35,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/0411f29f5c1149f1a0a7235f13671c49 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/0411f29f5c1149f1a0a7235f13671c49 2023-02-07 16:57:35,637 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230207803ffadad6404438aa80e304acc416e8_del 2023-02-07 16:57:35,638 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207803ffadad6404438aa80e304acc416e8_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207803ffadad6404438aa80e304acc416e8_del 2023-02-07 16:57:36,054 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 070aaaacf15e44ed8ee39309124efebe 2023-02-07 16:57:36,056 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/070aaaacf15e44ed8ee39309124efebe as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/070aaaacf15e44ed8ee39309124efebe 2023-02-07 16:57:36,062 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 070aaaacf15e44ed8ee39309124efebe 2023-02-07 16:57:36,063 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3ff1b383efaf25127b1cd74ca8c0cbeb/family2 of 3ff1b383efaf25127b1cd74ca8c0cbeb into 070aaaacf15e44ed8ee39309124efebe(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:57:36,064 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:36,064 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:36,064 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 4796dff8992ae0816c515956a8e0eae1/family1 is initiating major compaction (all files) 2023-02-07 16:57:36,064 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:57:36,064 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:57:36,064 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 4796dff8992ae0816c515956a8e0eae1/family1 in testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:36,064 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/45a160c072814a38a272a04e6d834061, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/7ef6a4deeb6e414e8b89cdac5ec39874, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/6554a0b5611642b38c5d3d014fc4093b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/362996dbff474ce2af5b79928b7220ba, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/d33b0817023c401e90ff57ec464a602a] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp, totalSize=26.7 K 2023-02-07 16:57:36,065 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 45a160c072814a38a272a04e6d834061, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040192 2023-02-07 16:57:36,066 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 7ef6a4deeb6e414e8b89cdac5ec39874, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:36,066 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 6554a0b5611642b38c5d3d014fc4093b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044335 2023-02-07 16:57:36,067 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 362996dbff474ce2af5b79928b7220ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046313 2023-02-07 16:57:36,067 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting d33b0817023c401e90ff57ec464a602a, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-07 16:57:36,082 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 4796dff8992ae0816c515956a8e0eae1#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:36,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/80506a2b80794344a71e5da1214aaa5e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/8e780a24c43a45ab991b58b69e05c0bc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/558aebd4298e4050b4a6e60c0079d521, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/b78f87102b614fb6a0336bc1a1090857, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/2e6080a673ff4121b156ccbead02665a] to archive 2023-02-07 16:57:36,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:36,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/80506a2b80794344a71e5da1214aaa5e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/80506a2b80794344a71e5da1214aaa5e 2023-02-07 16:57:36,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/8e780a24c43a45ab991b58b69e05c0bc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/8e780a24c43a45ab991b58b69e05c0bc 2023-02-07 16:57:36,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/558aebd4298e4050b4a6e60c0079d521 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/558aebd4298e4050b4a6e60c0079d521 2023-02-07 16:57:36,169 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/b78f87102b614fb6a0336bc1a1090857 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/b78f87102b614fb6a0336bc1a1090857 2023-02-07 16:57:36,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/2e6080a673ff4121b156ccbead02665a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/2e6080a673ff4121b156ccbead02665a 2023-02-07 16:57:36,491 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230207215f61c4e57d49eca0b2d23e4b6976e0_del 2023-02-07 16:57:36,491 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207215f61c4e57d49eca0b2d23e4b6976e0_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207215f61c4e57d49eca0b2d23e4b6976e0_del 2023-02-07 16:57:37,310 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecccbd6dc087497ab615e253fff08048 2023-02-07 16:57:37,311 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/ecccbd6dc087497ab615e253fff08048 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/ecccbd6dc087497ab615e253fff08048 2023-02-07 16:57:37,316 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecccbd6dc087497ab615e253fff08048 2023-02-07 16:57:37,317 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4796dff8992ae0816c515956a8e0eae1/family1 of 4796dff8992ae0816c515956a8e0eae1 into ecccbd6dc087497ab615e253fff08048(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:37,317 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:37,317 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:37,317 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 4796dff8992ae0816c515956a8e0eae1/family2 is initiating major compaction (all files) 2023-02-07 16:57:37,317 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:57:37,317 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:57:37,318 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 4796dff8992ae0816c515956a8e0eae1/family2 in testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:37,318 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/7688d830bdaa4e118fc5b9ecb03c11dc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/ba63c6e9b5e740b6af1809b59061b847, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/54c1e42d1e5d4926bbb7e2b5837a7467, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/cb033056a24e462990e5bd567722e775, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/6ce7240673344fd9be2660ca981dc48b] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp, totalSize=25.4 K 2023-02-07 16:57:37,318 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 7688d830bdaa4e118fc5b9ecb03c11dc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040192 2023-02-07 16:57:37,319 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting ba63c6e9b5e740b6af1809b59061b847, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:37,319 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 54c1e42d1e5d4926bbb7e2b5837a7467, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044335 2023-02-07 16:57:37,319 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting cb033056a24e462990e5bd567722e775, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046313 2023-02-07 16:57:37,320 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 6ce7240673344fd9be2660ca981dc48b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-07 16:57:37,354 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 4796dff8992ae0816c515956a8e0eae1#family2#compaction#111 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:37,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/45a160c072814a38a272a04e6d834061, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/7ef6a4deeb6e414e8b89cdac5ec39874, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/6554a0b5611642b38c5d3d014fc4093b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/362996dbff474ce2af5b79928b7220ba, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/d33b0817023c401e90ff57ec464a602a] to archive 2023-02-07 16:57:37,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:37,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/45a160c072814a38a272a04e6d834061 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/45a160c072814a38a272a04e6d834061 2023-02-07 16:57:37,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/7ef6a4deeb6e414e8b89cdac5ec39874 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/7ef6a4deeb6e414e8b89cdac5ec39874 2023-02-07 16:57:37,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/6554a0b5611642b38c5d3d014fc4093b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/6554a0b5611642b38c5d3d014fc4093b 2023-02-07 16:57:37,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/362996dbff474ce2af5b79928b7220ba to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/362996dbff474ce2af5b79928b7220ba 2023-02-07 16:57:37,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/d33b0817023c401e90ff57ec464a602a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/d33b0817023c401e90ff57ec464a602a 2023-02-07 16:57:37,367 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230207541be052313b49768717c46bda0182f3_del 2023-02-07 16:57:37,367 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207541be052313b49768717c46bda0182f3_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207541be052313b49768717c46bda0182f3_del 2023-02-07 16:57:37,792 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3a426dcbfb74b95a2f153f70e24c62e 2023-02-07 16:57:37,793 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/c3a426dcbfb74b95a2f153f70e24c62e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/c3a426dcbfb74b95a2f153f70e24c62e 2023-02-07 16:57:37,798 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c3a426dcbfb74b95a2f153f70e24c62e 2023-02-07 16:57:37,799 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4796dff8992ae0816c515956a8e0eae1/family2 of 4796dff8992ae0816c515956a8e0eae1 into c3a426dcbfb74b95a2f153f70e24c62e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:57:37,799 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:37,799 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:37,799 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): b2de3b9bcecdb49123cc636ca7bf881a/family1 is initiating major compaction (all files) 2023-02-07 16:57:37,799 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:57:37,799 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:57:37,800 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of b2de3b9bcecdb49123cc636ca7bf881a/family1 in testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:37,800 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/d60b3c69f6d2478190cc6c8eabd5958a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/92fb8344529940d8b39442ca7bfc53bd, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/e13267b2867d4466844cd3f3f35c8cda, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/5e806afdb21845fab62f2b4f067205b5] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp, totalSize=26.7 K 2023-02-07 16:57:37,801 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting d60b3c69f6d2478190cc6c8eabd5958a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040193 2023-02-07 16:57:37,802 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 92fb8344529940d8b39442ca7bfc53bd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:37,802 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting e13267b2867d4466844cd3f3f35c8cda, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044335 2023-02-07 16:57:37,802 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 4bc11d1ce16b4c01b4d98beb4fcdaa7d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046314 2023-02-07 16:57:37,803 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 5e806afdb21845fab62f2b4f067205b5, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-07 16:57:37,830 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): b2de3b9bcecdb49123cc636ca7bf881a#family1#compaction#112 average throughput is 0.28 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:37,852 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/7688d830bdaa4e118fc5b9ecb03c11dc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/ba63c6e9b5e740b6af1809b59061b847, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/54c1e42d1e5d4926bbb7e2b5837a7467, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/cb033056a24e462990e5bd567722e775, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/6ce7240673344fd9be2660ca981dc48b] to archive 2023-02-07 16:57:37,853 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:37,855 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/7688d830bdaa4e118fc5b9ecb03c11dc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/7688d830bdaa4e118fc5b9ecb03c11dc 2023-02-07 16:57:37,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/ba63c6e9b5e740b6af1809b59061b847 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/ba63c6e9b5e740b6af1809b59061b847 2023-02-07 16:57:37,857 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/54c1e42d1e5d4926bbb7e2b5837a7467 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/54c1e42d1e5d4926bbb7e2b5837a7467 2023-02-07 16:57:37,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/cb033056a24e462990e5bd567722e775 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/cb033056a24e462990e5bd567722e775 2023-02-07 16:57:37,859 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/6ce7240673344fd9be2660ca981dc48b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/6ce7240673344fd9be2660ca981dc48b 2023-02-07 16:57:38,245 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020748ad3bc258294c8398ef129e1806fc79_del 2023-02-07 16:57:38,246 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020748ad3bc258294c8398ef129e1806fc79_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020748ad3bc258294c8398ef129e1806fc79_del 2023-02-07 16:57:39,071 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cab3ee6d7f7748e5a6c79ed32212bc46 2023-02-07 16:57:39,072 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/cab3ee6d7f7748e5a6c79ed32212bc46 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/cab3ee6d7f7748e5a6c79ed32212bc46 2023-02-07 16:57:39,076 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cab3ee6d7f7748e5a6c79ed32212bc46 2023-02-07 16:57:39,077 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b2de3b9bcecdb49123cc636ca7bf881a/family1 of b2de3b9bcecdb49123cc636ca7bf881a into cab3ee6d7f7748e5a6c79ed32212bc46(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:39,077 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:39,077 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:39,077 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): b2de3b9bcecdb49123cc636ca7bf881a/family2 is initiating major compaction (all files) 2023-02-07 16:57:39,078 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:57:39,078 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:57:39,078 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of b2de3b9bcecdb49123cc636ca7bf881a/family2 in testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:39,078 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/2ee4b808c376418396eb230b612c4798, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8139e79486ed48a5ac9e3e79b1aec530, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/338141da13724c34a459d565dfd6e270, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/6ce43f55a3004c2d9cf992f8f280d75b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8e2747378b5a4affb61d065f065696c0] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp, totalSize=25.4 K 2023-02-07 16:57:39,078 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 2ee4b808c376418396eb230b612c4798, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040193 2023-02-07 16:57:39,079 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 8139e79486ed48a5ac9e3e79b1aec530, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:39,079 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 338141da13724c34a459d565dfd6e270, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044335 2023-02-07 16:57:39,079 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 6ce43f55a3004c2d9cf992f8f280d75b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046314 2023-02-07 16:57:39,080 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 8e2747378b5a4affb61d065f065696c0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-07 16:57:39,089 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): b2de3b9bcecdb49123cc636ca7bf881a#family2#compaction#113 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:39,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/d60b3c69f6d2478190cc6c8eabd5958a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/92fb8344529940d8b39442ca7bfc53bd, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/e13267b2867d4466844cd3f3f35c8cda, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/5e806afdb21845fab62f2b4f067205b5] to archive 2023-02-07 16:57:39,159 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:39,161 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/d60b3c69f6d2478190cc6c8eabd5958a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/d60b3c69f6d2478190cc6c8eabd5958a 2023-02-07 16:57:39,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/92fb8344529940d8b39442ca7bfc53bd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/92fb8344529940d8b39442ca7bfc53bd 2023-02-07 16:57:39,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/e13267b2867d4466844cd3f3f35c8cda to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/e13267b2867d4466844cd3f3f35c8cda 2023-02-07 16:57:39,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/4bc11d1ce16b4c01b4d98beb4fcdaa7d 2023-02-07 16:57:39,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/5e806afdb21845fab62f2b4f067205b5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/5e806afdb21845fab62f2b4f067205b5 2023-02-07 16:57:39,507 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020734460d8ed63f4521a6f9b331c591259a_del 2023-02-07 16:57:39,507 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020734460d8ed63f4521a6f9b331c591259a_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020734460d8ed63f4521a6f9b331c591259a_del 2023-02-07 16:57:40,334 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 063f14da27fa41ba9dd73cfdce1e10a8 2023-02-07 16:57:40,336 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/063f14da27fa41ba9dd73cfdce1e10a8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/063f14da27fa41ba9dd73cfdce1e10a8 2023-02-07 16:57:40,341 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 063f14da27fa41ba9dd73cfdce1e10a8 2023-02-07 16:57:40,342 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b2de3b9bcecdb49123cc636ca7bf881a/family2 of b2de3b9bcecdb49123cc636ca7bf881a into 063f14da27fa41ba9dd73cfdce1e10a8(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:40,342 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:40,348 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:40,353 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:40,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/2ee4b808c376418396eb230b612c4798, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8139e79486ed48a5ac9e3e79b1aec530, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/338141da13724c34a459d565dfd6e270, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/6ce43f55a3004c2d9cf992f8f280d75b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8e2747378b5a4affb61d065f065696c0] to archive 2023-02-07 16:57:40,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:40,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/2ee4b808c376418396eb230b612c4798 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/2ee4b808c376418396eb230b612c4798 2023-02-07 16:57:40,361 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:40,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8139e79486ed48a5ac9e3e79b1aec530 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8139e79486ed48a5ac9e3e79b1aec530 2023-02-07 16:57:40,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/338141da13724c34a459d565dfd6e270 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/338141da13724c34a459d565dfd6e270 2023-02-07 16:57:40,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/6ce43f55a3004c2d9cf992f8f280d75b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/6ce43f55a3004c2d9cf992f8f280d75b 2023-02-07 16:57:40,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8e2747378b5a4affb61d065f065696c0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/8e2747378b5a4affb61d065f065696c0 2023-02-07 16:57:40,368 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:40,376 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-07 16:57:40,414 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-07 16:57:40,418 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230207215f61c4e57d49eca0b2d23e4b6976e0_del 2023-02-07 16:57:40,422 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020748ad3bc258294c8398ef129e1806fc79_del 2023-02-07 16:57:40,425 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230207aa106e1939e64898b1af08832bef9fee_del 2023-02-07 16:57:40,425 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:40,425 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ReadOnlyZKClient(139): Connect 0x48144f16 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:57:40,449 DEBUG [Listener at localhost.localdomain/41849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67dd9167, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:57:40,450 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:40,450 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:40,450 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:40,914 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207207ad718b18f481dbbb0d87e095131d5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207207ad718b18f481dbbb0d87e095131d5 2023-02-07 16:57:40,914 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302073404bc3cf9274cd69ba78dae5d4affcc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302073404bc3cf9274cd69ba78dae5d4affcc 2023-02-07 16:57:40,915 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:40,915 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:40,927 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:57:40,931 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:42134, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:57:40,936 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:40,936 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:40,937 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:40,937 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:57:40,939 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39066, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:57:40,940 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:40,940 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:40,956 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-07 16:57:40,957 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e}] 2023-02-07 16:57:40,958 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207/family1/c83e529c26524de991dcf2f3ca401bb4 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-07 16:57:40,961 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207/family1/c83e529c26524de991dcf2f3ca401bb4}] 2023-02-07 16:57:40,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207/family1/c83e529c26524de991dcf2f3ca401bb4 for inclusion in 4796dff8992ae0816c515956a8e0eae1/family1 2023-02-07 16:57:40,968 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e for inclusion in 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 2023-02-07 16:57:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-07 16:57:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-07 16:57:40,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:40,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-07 16:57:40,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last=1 2023-02-07 16:57:40,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:40,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__bk6sopch4kk1to884sh7o7bimc89k4n0a4tsivv5spknpemeo4brvd3st8ut4e2k/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e 2023-02-07 16:57:40,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207/family1/c83e529c26524de991dcf2f3ca401bb4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__r26fq2tems48pdvdro5h72e0oge3akbhhpo0qimss3muclplt2ffseibv2n9r9ea/family1/c83e529c26524de991dcf2f3ca401bb4 2023-02-07 16:57:40,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__bk6sopch4kk1to884sh7o7bimc89k4n0a4tsivv5spknpemeo4brvd3st8ut4e2k/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/37d07138b7bf4576b71cd81cd2163a40_SeqId_29_ 2023-02-07 16:57:40,976 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__bk6sopch4kk1to884sh7o7bimc89k4n0a4tsivv5spknpemeo4brvd3st8ut4e2k/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e into 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/37d07138b7bf4576b71cd81cd2163a40_SeqId_29_ - updating store file list. 2023-02-07 16:57:40,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__r26fq2tems48pdvdro5h72e0oge3akbhhpo0qimss3muclplt2ffseibv2n9r9ea/family1/c83e529c26524de991dcf2f3ca401bb4 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/8f19158681a0434882b4da8c631093ec_SeqId_29_ 2023-02-07 16:57:40,977 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__r26fq2tems48pdvdro5h72e0oge3akbhhpo0qimss3muclplt2ffseibv2n9r9ea/family1/c83e529c26524de991dcf2f3ca401bb4 into 4796dff8992ae0816c515956a8e0eae1/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/8f19158681a0434882b4da8c631093ec_SeqId_29_ - updating store file list. 2023-02-07 16:57:40,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/37d07138b7bf4576b71cd81cd2163a40_SeqId_29_ into 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 2023-02-07 16:57:40,979 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__bk6sopch4kk1to884sh7o7bimc89k4n0a4tsivv5spknpemeo4brvd3st8ut4e2k/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e into 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/37d07138b7bf4576b71cd81cd2163a40_SeqId_29_) 2023-02-07 16:57:40,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__bk6sopch4kk1to884sh7o7bimc89k4n0a4tsivv5spknpemeo4brvd3st8ut4e2k/family1/da8207f2a3c24aadbfb20fc5b6e8cf6e 2023-02-07 16:57:40,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/8f19158681a0434882b4da8c631093ec_SeqId_29_ into 4796dff8992ae0816c515956a8e0eae1/family1 2023-02-07 16:57:40,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__r26fq2tems48pdvdro5h72e0oge3akbhhpo0qimss3muclplt2ffseibv2n9r9ea/family1/c83e529c26524de991dcf2f3ca401bb4 into 4796dff8992ae0816c515956a8e0eae1/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/8f19158681a0434882b4da8c631093ec_SeqId_29_) 2023-02-07 16:57:40,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__r26fq2tems48pdvdro5h72e0oge3akbhhpo0qimss3muclplt2ffseibv2n9r9ea/family1/c83e529c26524de991dcf2f3ca401bb4 2023-02-07 16:57:40,982 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:40,982 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:40,983 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:40,983 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:40,987 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78 2023-02-07 16:57:40,987 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a 2023-02-07 16:57:40,992 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec 2023-02-07 16:57:40,992 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64 2023-02-07 16:57:40,993 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541 2023-02-07 16:57:40,994 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a 2023-02-07 16:57:40,995 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82 2023-02-07 16:57:40,995 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-07 16:57:40,995 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207' 2023-02-07 16:57:40,995 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317 2023-02-07 16:57:40,995 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-07 16:57:40,995 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207' 2023-02-07 16:57:40,996 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:40,996 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:41,319 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207d9576a461cb248beb99dfd1e491fc9ec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207d9576a461cb248beb99dfd1e491fc9ec 2023-02-07 16:57:41,320 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:41,340 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:41,340 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:41,346 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207/family1/bf7c219991464460822c26e43a6386d2 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-07 16:57:41,347 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207/family1/bf7c219991464460822c26e43a6386d2}] 2023-02-07 16:57:41,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207/family1/bf7c219991464460822c26e43a6386d2 for inclusion in b2de3b9bcecdb49123cc636ca7bf881a/family1 2023-02-07 16:57:41,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-07 16:57:41,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-07 16:57:41,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:41,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207/family1/bf7c219991464460822c26e43a6386d2 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__t49nljgnarepdhsjbep98ondisf2ne5v9c8626hn4erpuiejhil5vfihutcdv2on/family1/bf7c219991464460822c26e43a6386d2 2023-02-07 16:57:41,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__t49nljgnarepdhsjbep98ondisf2ne5v9c8626hn4erpuiejhil5vfihutcdv2on/family1/bf7c219991464460822c26e43a6386d2 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/385c715c408944d9a3f2cda20f958b75_SeqId_29_ 2023-02-07 16:57:41,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__t49nljgnarepdhsjbep98ondisf2ne5v9c8626hn4erpuiejhil5vfihutcdv2on/family1/bf7c219991464460822c26e43a6386d2 into b2de3b9bcecdb49123cc636ca7bf881a/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/385c715c408944d9a3f2cda20f958b75_SeqId_29_ - updating store file list. 2023-02-07 16:57:41,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/385c715c408944d9a3f2cda20f958b75_SeqId_29_ into b2de3b9bcecdb49123cc636ca7bf881a/family1 2023-02-07 16:57:41,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__t49nljgnarepdhsjbep98ondisf2ne5v9c8626hn4erpuiejhil5vfihutcdv2on/family1/bf7c219991464460822c26e43a6386d2 into b2de3b9bcecdb49123cc636ca7bf881a/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/385c715c408944d9a3f2cda20f958b75_SeqId_29_) 2023-02-07 16:57:41,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__t49nljgnarepdhsjbep98ondisf2ne5v9c8626hn4erpuiejhil5vfihutcdv2on/family1/bf7c219991464460822c26e43a6386d2 2023-02-07 16:57:41,361 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:41,362 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:41,363 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81 2023-02-07 16:57:41,364 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb 2023-02-07 16:57:41,365 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f 2023-02-07 16:57:41,366 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111 2023-02-07 16:57:41,366 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-07 16:57:41,366 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207' 2023-02-07 16:57:41,366 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:41,366 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:41,366 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:41,366 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207215f61c4e57d49eca0b2d23e4b6976e0_del] 2023-02-07 16:57:41,367 DEBUG [Listener at localhost.localdomain/41849] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:41,368 DEBUG [Listener at localhost.localdomain/41849] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207215f61c4e57d49eca0b2d23e4b6976e0_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207215f61c4e57d49eca0b2d23e4b6976e0_del 2023-02-07 16:57:41,368 INFO [Listener at localhost.localdomain/41849] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-07 16:57:41,368 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020748ad3bc258294c8398ef129e1806fc79_del] 2023-02-07 16:57:41,368 DEBUG [Listener at localhost.localdomain/41849] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:41,370 DEBUG [Listener at localhost.localdomain/41849] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020748ad3bc258294c8398ef129e1806fc79_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023020748ad3bc258294c8398ef129e1806fc79_del 2023-02-07 16:57:41,370 INFO [Listener at localhost.localdomain/41849] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-07 16:57:41,370 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207aa106e1939e64898b1af08832bef9fee_del] 2023-02-07 16:57:41,371 DEBUG [Listener at localhost.localdomain/41849] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:41,372 DEBUG [Listener at localhost.localdomain/41849] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207aa106e1939e64898b1af08832bef9fee_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230207aa106e1939e64898b1af08832bef9fee_del 2023-02-07 16:57:41,372 INFO [Listener at localhost.localdomain/41849] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-07 16:57:41,375 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:41,378 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:41,382 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:41,384 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:41,389 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:41,389 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:41,389 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-07 16:57:41,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$11(2405): Client=jenkins//136.243.104.168 disable testCompactionWithHFileLink 2023-02-07 16:57:41,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-07 16:57:41,392 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:41,392 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:41,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-07 16:57:41,393 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789061393"}]},"ts":"1675789061393"} 2023-02-07 16:57:41,394 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-07 16:57:41,406 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-07 16:57:41,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, UNASSIGN}] 2023-02-07 16:57:41,409 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, UNASSIGN 2023-02-07 16:57:41,409 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, UNASSIGN 2023-02-07 16:57:41,409 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, UNASSIGN 2023-02-07 16:57:41,410 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=b2de3b9bcecdb49123cc636ca7bf881a, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:41,410 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=4796dff8992ae0816c515956a8e0eae1, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:41,410 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3ff1b383efaf25127b1cd74ca8c0cbeb, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:41,410 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789061410"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789061410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789061410"}]},"ts":"1675789061410"} 2023-02-07 16:57:41,410 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789061410"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789061410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789061410"}]},"ts":"1675789061410"} 2023-02-07 16:57:41,410 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789061410"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789061410"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789061410"}]},"ts":"1675789061410"} 2023-02-07 16:57:41,411 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure 4796dff8992ae0816c515956a8e0eae1, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:41,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure b2de3b9bcecdb49123cc636ca7bf881a, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:41,412 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 3ff1b383efaf25127b1cd74ca8c0cbeb, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:41,493 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:41,493 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:41,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-07 16:57:41,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:41,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 3ff1b383efaf25127b1cd74ca8c0cbeb, disabling compactions & flushes 2023-02-07 16:57:41,563 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:41,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:41,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. after waiting 0 ms 2023-02-07 16:57:41,563 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:41,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-07 16:57:41,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:41,568 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: Waiting for close lock at 1675789061563Running coprocessor pre-close hooks at 1675789061563Disabling compacts and flushes for region at 1675789061563Disabling writes for close at 1675789061563Writing region close event to WAL at 1675789061564 (+1 ms)Running coprocessor post-close hooks at 1675789061568 (+4 ms)Closed at 1675789061568 2023-02-07 16:57:41,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:41,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:41,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 4796dff8992ae0816c515956a8e0eae1, disabling compactions & flushes 2023-02-07 16:57:41,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:41,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:41,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. after waiting 0 ms 2023-02-07 16:57:41,570 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:41,570 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3ff1b383efaf25127b1cd74ca8c0cbeb, regionState=CLOSED 2023-02-07 16:57:41,570 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789061570"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789061570"}]},"ts":"1675789061570"} 2023-02-07 16:57:41,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-02-07 16:57:41,573 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 3ff1b383efaf25127b1cd74ca8c0cbeb, server=jenkins-hbase12.apache.org,33237,1675788923983 in 159 msec 2023-02-07 16:57:41,573 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, UNASSIGN in 166 msec 2023-02-07 16:57:41,573 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-07 16:57:41,574 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:41,574 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 4796dff8992ae0816c515956a8e0eae1: Waiting for close lock at 1675789061570Running coprocessor pre-close hooks at 1675789061570Disabling compacts and flushes for region at 1675789061570Disabling writes for close at 1675789061570Writing region close event to WAL at 1675789061571 (+1 ms)Running coprocessor post-close hooks at 1675789061574 (+3 ms)Closed at 1675789061574 2023-02-07 16:57:41,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:41,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:41,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing b2de3b9bcecdb49123cc636ca7bf881a, disabling compactions & flushes 2023-02-07 16:57:41,576 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:41,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:41,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. after waiting 0 ms 2023-02-07 16:57:41,576 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=4796dff8992ae0816c515956a8e0eae1, regionState=CLOSED 2023-02-07 16:57:41,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:41,576 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789061576"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789061576"}]},"ts":"1675789061576"} 2023-02-07 16:57:41,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=89 2023-02-07 16:57:41,579 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure 4796dff8992ae0816c515956a8e0eae1, server=jenkins-hbase12.apache.org,33237,1675788923983 in 167 msec 2023-02-07 16:57:41,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, UNASSIGN in 172 msec 2023-02-07 16:57:41,581 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-07 16:57:41,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:41,582 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for b2de3b9bcecdb49123cc636ca7bf881a: Waiting for close lock at 1675789061576Running coprocessor pre-close hooks at 1675789061576Disabling compacts and flushes for region at 1675789061576Disabling writes for close at 1675789061576Writing region close event to WAL at 1675789061578 (+2 ms)Running coprocessor post-close hooks at 1675789061581 (+3 ms)Closed at 1675789061582 (+1 ms) 2023-02-07 16:57:41,583 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:41,583 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=b2de3b9bcecdb49123cc636ca7bf881a, regionState=CLOSED 2023-02-07 16:57:41,583 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789061583"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789061583"}]},"ts":"1675789061583"} 2023-02-07 16:57:41,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-02-07 16:57:41,586 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure b2de3b9bcecdb49123cc636ca7bf881a, server=jenkins-hbase12.apache.org,33237,1675788923983 in 172 msec 2023-02-07 16:57:41,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=90, resume processing ppid=88 2023-02-07 16:57:41,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, UNASSIGN in 179 msec 2023-02-07 16:57:41,587 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789061587"}]},"ts":"1675789061587"} 2023-02-07 16:57:41,588 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-07 16:57:41,597 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-07 16:57:41,599 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 208 msec 2023-02-07 16:57:41,694 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:41,695 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:41,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-07 16:57:41,696 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-07 16:57:41,696 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:41,696 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:41,705 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1675789047827-1675789061705 2023-02-07 16:57:41,705 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:41,705 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:41,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1580): Client=jenkins//136.243.104.168 snapshot request for:{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-07 16:57:41,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675789061706 (current time:1675789061706). 2023-02-07 16:57:41,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-07 16:57:41,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] zookeeper.ReadOnlyZKClient(139): Connect 0x0a92069e to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:57:41,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f05e2c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:57:41,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:57:41,717 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:42138, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:57:41,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a92069e to 127.0.0.1:56335 2023-02-07 16:57:41,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:57:41,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-07 16:57:41,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-07 16:57:41,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-07 16:57:41,722 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-07 16:57:41,723 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675789661723 2023-02-07 16:57:41,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-07 16:57:41,723 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1675789047827-1675789061705 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-07 16:57:41,723 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:41,723 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-07 16:57:41,824 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:41,824 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:41,824 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:41,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:41,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:41,828 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-07 16:57:42,028 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:42,028 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:42,029 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:42,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:42,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:42,031 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-07 16:57:42,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-07 16:57:42,134 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-07 16:57:42,134 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-07 16:57:42,134 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-07 16:57:42,134 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-07 16:57:42,134 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-07 16:57:42,134 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-07 16:57:42,134 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-07 16:57:42,134 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-07 16:57:42,137 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/8f19158681a0434882b4da8c631093ec_SeqId_29_, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/ecccbd6dc087497ab615e253fff08048] hfiles 2023-02-07 16:57:42,137 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/8f19158681a0434882b4da8c631093ec_SeqId_29_ 2023-02-07 16:57:42,137 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/385c715c408944d9a3f2cda20f958b75_SeqId_29_, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/cab3ee6d7f7748e5a6c79ed32212bc46] hfiles 2023-02-07 16:57:42,137 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/ecccbd6dc087497ab615e253fff08048 2023-02-07 16:57:42,137 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/37d07138b7bf4576b71cd81cd2163a40_SeqId_29_, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/e923fa4990b84591815f4cf2a207f2fb] hfiles 2023-02-07 16:57:42,137 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/385c715c408944d9a3f2cda20f958b75_SeqId_29_ 2023-02-07 16:57:42,137 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/37d07138b7bf4576b71cd81cd2163a40_SeqId_29_ 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/cab3ee6d7f7748e5a6c79ed32212bc46 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207d9576a461cb248beb99dfd1e491fc9ec, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302073404bc3cf9274cd69ba78dae5d4affcc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207207ad718b18f481dbbb0d87e095131d5] hfiles 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/e923fa4990b84591815f4cf2a207f2fb 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207d9576a461cb248beb99dfd1e491fc9ec 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302073404bc3cf9274cd69ba78dae5d4affcc 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207207ad718b18f481dbbb0d87e095131d5 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/c3a426dcbfb74b95a2f153f70e24c62e] hfiles 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/c3a426dcbfb74b95a2f153f70e24c62e 2023-02-07 16:57:42,138 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/063f14da27fa41ba9dd73cfdce1e10a8] hfiles 2023-02-07 16:57:42,139 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/063f14da27fa41ba9dd73cfdce1e10a8 2023-02-07 16:57:42,139 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/070aaaacf15e44ed8ee39309124efebe] hfiles 2023-02-07 16:57:42,139 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/070aaaacf15e44ed8ee39309124efebe 2023-02-07 16:57:42,149 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020734460d8ed63f4521a6f9b331c591259a_del, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207603aee7f444f4f1da25f7f7ed6063417, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302076b9d6e94f3b04f8f908dc3dd91327831, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302079da900a11ac04f14b0da8fd406e551b8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207bf13b99ac02e4164ac18637e670ea6bc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207182c5b8f53fb4c3b9453e3373b796e15, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302075cab5282012846daa3af3adecb71cecf, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207803ffadad6404438aa80e304acc416e8_del, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207921d5dc04d8749079265294060e0017e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207d2909d41820746719865704c67e53e9f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207541be052313b49768717c46bda0182f3_del, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076307ca5eb6ff4090b7a31e1ed23ae720, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076d3b2bf41ce04690b5c15b0f98a90aa8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207769490ffdff84a85bd3a8a2230eb37e2, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207a3ddd97f1746414c82d47a59ae27cd17] hfiles 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020734460d8ed63f4521a6f9b331c591259a_del 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207603aee7f444f4f1da25f7f7ed6063417 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302076b9d6e94f3b04f8f908dc3dd91327831 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302079da900a11ac04f14b0da8fd406e551b8 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230207bf13b99ac02e4164ac18637e670ea6bc 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207182c5b8f53fb4c3b9453e3373b796e15 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302075cab5282012846daa3af3adecb71cecf 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207803ffadad6404438aa80e304acc416e8_del 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207921d5dc04d8749079265294060e0017e 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207d2909d41820746719865704c67e53e9f 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207541be052313b49768717c46bda0182f3_del 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076307ca5eb6ff4090b7a31e1ed23ae720 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302076d3b2bf41ce04690b5c15b0f98a90aa8 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207769490ffdff84a85bd3a8a2230eb37e2 2023-02-07 16:57:42,150 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207a3ddd97f1746414c82d47a59ae27cd17 2023-02-07 16:57:42,331 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:42,331 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:42,331 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:42,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:42,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:42,333 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-07 16:57:42,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-07 16:57:42,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1675789047827-1675789061705 2023-02-07 16:57:42,556 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675789047827-1675789061705 2023-02-07 16:57:42,833 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:42,833 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:42,833 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:42,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:42,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-07 16:57:42,835 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-07 16:57:42,987 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675789047827-1675789061705 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/hbase-failsafe-snaptb-1675789047827-1675789061705 2023-02-07 16:57:43,810 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1675789047827-1675789061705 of table testCompactionWithHFileLink completed 2023-02-07 16:57:43,810 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675789047827-1675789061705 2023-02-07 16:57:43,811 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675789047827-1675789061705 2023-02-07 16:57:43,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1675789047827-1675789061705 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675789061723Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1675789062132 (+409 ms)Consolidate snapshot: hbase-failsafe-snaptb-1675789047827-1675789061705 at 1675789062555 (+423 ms)Loading Region manifests for hbase-failsafe-snaptb-1675789047827-1675789061705 at 1675789062555Writing data manifest for hbase-failsafe-snaptb-1675789047827-1675789061705 at 1675789062561 (+6 ms)Verifying snapshot: hbase-failsafe-snaptb-1675789047827-1675789061705 at 1675789062970 (+409 ms)Snapshot hbase-failsafe-snaptb-1675789047827-1675789061705 of table testCompactionWithHFileLink completed at 1675789063810 (+840 ms) 2023-02-07 16:57:43,813 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-07 16:57:43,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 2.0930 sec 2023-02-07 16:57:43,835 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-07 16:57:43,836 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:43,836 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:43,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-07 16:57:43,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1675789047827-1675789061705 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-07 16:57:43,840 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:43,840 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:43,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675789047827" table: "testCompactionWithHFileLink" creation_time: 1675789047835 type: FLUSH version: 2 ttl: 0 ) 2023-02-07 16:57:43,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1675789047827 as table=testCompactionWithHFileLink 2023-02-07 16:57:43,884 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:43,884 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:43,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-07 16:57:43,985 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:43,986 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:43,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-07 16:57:44,188 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:44,189 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:44,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-07 16:57:44,295 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-07 16:57:44,297 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-07 16:57:44,298 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-07 16:57:44,300 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-07 16:57:44,305 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1675789047827" table: "testCompactionWithHFileLink" creation_time: 1675789047835 type: FLUSH version: 2 ttl: 0 2023-02-07 16:57:44,306 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink 2023-02-07 16:57:44,310 DEBUG [PEWorker-1] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-07 16:57:44,313 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207d9576a461cb248beb99dfd1e491fc9ec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230207d9576a461cb248beb99dfd1e491fc9ec 2023-02-07 16:57:44,314 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302073404bc3cf9274cd69ba78dae5d4affcc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302073404bc3cf9274cd69ba78dae5d4affcc 2023-02-07 16:57:44,315 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207207ad718b18f481dbbb0d87e095131d5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230207207ad718b18f481dbbb0d87e095131d5 2023-02-07 16:57:44,316 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81 of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,319 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,323 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,327 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111 of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,329 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,331 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,334 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541 of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,336 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82 of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,338 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78 of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,341 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64 of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,343 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,346 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317 of snapshot=snaptb-1675789047827 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-07 16:57:44,350 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207541be052313b49768717c46bda0182f3_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230207541be052313b49768717c46bda0182f3_del 2023-02-07 16:57:44,351 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020734460d8ed63f4521a6f9b331c591259a_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020734460d8ed63f4521a6f9b331c591259a_del 2023-02-07 16:57:44,352 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207803ffadad6404438aa80e304acc416e8_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230207803ffadad6404438aa80e304acc416e8_del 2023-02-07 16:57:44,353 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:44,353 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,353 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(223): region to restore: b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:44,356 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/ecccbd6dc087497ab615e253fff08048 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/ecccbd6dc087497ab615e253fff08048 2023-02-07 16:57:44,357 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/e923fa4990b84591815f4cf2a207f2fb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/e923fa4990b84591815f4cf2a207f2fb 2023-02-07 16:57:44,357 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/385c715c408944d9a3f2cda20f958b75_SeqId_29_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/385c715c408944d9a3f2cda20f958b75_SeqId_29_ 2023-02-07 16:57:44,357 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/8f19158681a0434882b4da8c631093ec_SeqId_29_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/8f19158681a0434882b4da8c631093ec_SeqId_29_ 2023-02-07 16:57:44,358 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 45a160c072814a38a272a04e6d834061 of snapshot=snaptb-1675789047827 to region=4796dff8992ae0816c515956a8e0eae1 table=testCompactionWithHFileLink 2023-02-07 16:57:44,358 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/37d07138b7bf4576b71cd81cd2163a40_SeqId_29_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/37d07138b7bf4576b71cd81cd2163a40_SeqId_29_ 2023-02-07 16:57:44,358 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8fc0c43777844ec9aa1e3a6fd3bcb170 of snapshot=snaptb-1675789047827 to region=3ff1b383efaf25127b1cd74ca8c0cbeb table=testCompactionWithHFileLink 2023-02-07 16:57:44,358 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/cab3ee6d7f7748e5a6c79ed32212bc46 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/cab3ee6d7f7748e5a6c79ed32212bc46 2023-02-07 16:57:44,358 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d60b3c69f6d2478190cc6c8eabd5958a of snapshot=snaptb-1675789047827 to region=b2de3b9bcecdb49123cc636ca7bf881a table=testCompactionWithHFileLink 2023-02-07 16:57:44,361 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7ef6a4deeb6e414e8b89cdac5ec39874 of snapshot=snaptb-1675789047827 to region=4796dff8992ae0816c515956a8e0eae1 table=testCompactionWithHFileLink 2023-02-07 16:57:44,361 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7c141e8341e04810aeb6e5bd3c21e0b3 of snapshot=snaptb-1675789047827 to region=3ff1b383efaf25127b1cd74ca8c0cbeb table=testCompactionWithHFileLink 2023-02-07 16:57:44,361 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 92fb8344529940d8b39442ca7bfc53bd of snapshot=snaptb-1675789047827 to region=b2de3b9bcecdb49123cc636ca7bf881a table=testCompactionWithHFileLink 2023-02-07 16:57:44,363 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6554a0b5611642b38c5d3d014fc4093b of snapshot=snaptb-1675789047827 to region=4796dff8992ae0816c515956a8e0eae1 table=testCompactionWithHFileLink 2023-02-07 16:57:44,363 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f9c14fe73c554c63994d084b3c17bb65 of snapshot=snaptb-1675789047827 to region=3ff1b383efaf25127b1cd74ca8c0cbeb table=testCompactionWithHFileLink 2023-02-07 16:57:44,364 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e13267b2867d4466844cd3f3f35c8cda of snapshot=snaptb-1675789047827 to region=b2de3b9bcecdb49123cc636ca7bf881a table=testCompactionWithHFileLink 2023-02-07 16:57:44,373 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 362996dbff474ce2af5b79928b7220ba of snapshot=snaptb-1675789047827 to region=4796dff8992ae0816c515956a8e0eae1 table=testCompactionWithHFileLink 2023-02-07 16:57:44,374 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d3a0a5e38f2749f1829b4d1c359f31e3 of snapshot=snaptb-1675789047827 to region=3ff1b383efaf25127b1cd74ca8c0cbeb table=testCompactionWithHFileLink 2023-02-07 16:57:44,374 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4bc11d1ce16b4c01b4d98beb4fcdaa7d of snapshot=snaptb-1675789047827 to region=b2de3b9bcecdb49123cc636ca7bf881a table=testCompactionWithHFileLink 2023-02-07 16:57:44,377 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/c3a426dcbfb74b95a2f153f70e24c62e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/c3a426dcbfb74b95a2f153f70e24c62e 2023-02-07 16:57:44,378 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7688d830bdaa4e118fc5b9ecb03c11dc of snapshot=snaptb-1675789047827 to region=4796dff8992ae0816c515956a8e0eae1 table=testCompactionWithHFileLink 2023-02-07 16:57:44,378 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/063f14da27fa41ba9dd73cfdce1e10a8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/063f14da27fa41ba9dd73cfdce1e10a8 2023-02-07 16:57:44,378 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2ee4b808c376418396eb230b612c4798 of snapshot=snaptb-1675789047827 to region=b2de3b9bcecdb49123cc636ca7bf881a table=testCompactionWithHFileLink 2023-02-07 16:57:44,390 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8139e79486ed48a5ac9e3e79b1aec530 of snapshot=snaptb-1675789047827 to region=b2de3b9bcecdb49123cc636ca7bf881a table=testCompactionWithHFileLink 2023-02-07 16:57:44,390 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ba63c6e9b5e740b6af1809b59061b847 of snapshot=snaptb-1675789047827 to region=4796dff8992ae0816c515956a8e0eae1 table=testCompactionWithHFileLink 2023-02-07 16:57:44,391 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/070aaaacf15e44ed8ee39309124efebe to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/070aaaacf15e44ed8ee39309124efebe 2023-02-07 16:57:44,391 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 80506a2b80794344a71e5da1214aaa5e of snapshot=snaptb-1675789047827 to region=3ff1b383efaf25127b1cd74ca8c0cbeb table=testCompactionWithHFileLink 2023-02-07 16:57:44,393 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 338141da13724c34a459d565dfd6e270 of snapshot=snaptb-1675789047827 to region=b2de3b9bcecdb49123cc636ca7bf881a table=testCompactionWithHFileLink 2023-02-07 16:57:44,393 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 54c1e42d1e5d4926bbb7e2b5837a7467 of snapshot=snaptb-1675789047827 to region=4796dff8992ae0816c515956a8e0eae1 table=testCompactionWithHFileLink 2023-02-07 16:57:44,393 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8e780a24c43a45ab991b58b69e05c0bc of snapshot=snaptb-1675789047827 to region=3ff1b383efaf25127b1cd74ca8c0cbeb table=testCompactionWithHFileLink 2023-02-07 16:57:44,395 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6ce43f55a3004c2d9cf992f8f280d75b of snapshot=snaptb-1675789047827 to region=b2de3b9bcecdb49123cc636ca7bf881a table=testCompactionWithHFileLink 2023-02-07 16:57:44,395 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink cb033056a24e462990e5bd567722e775 of snapshot=snaptb-1675789047827 to region=4796dff8992ae0816c515956a8e0eae1 table=testCompactionWithHFileLink 2023-02-07 16:57:44,396 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 558aebd4298e4050b4a6e60c0079d521 of snapshot=snaptb-1675789047827 to region=3ff1b383efaf25127b1cd74ca8c0cbeb table=testCompactionWithHFileLink 2023-02-07 16:57:44,398 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b78f87102b614fb6a0336bc1a1090857 of snapshot=snaptb-1675789047827 to region=3ff1b383efaf25127b1cd74ca8c0cbeb table=testCompactionWithHFileLink 2023-02-07 16:57:44,400 INFO [PEWorker-1] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1675789047827" table: "testCompactionWithHFileLink" creation_time: 1675789047835 type: FLUSH version: 2 ttl: 0 2023-02-07 16:57:44,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675789064401"}]},"ts":"9223372036854775807"} 2023-02-07 16:57:44,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675789064401"}]},"ts":"9223372036854775807"} 2023-02-07 16:57:44,401 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675789064401"}]},"ts":"9223372036854775807"} 2023-02-07 16:57:44,403 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-07 16:57:44,403 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3ff1b383efaf25127b1cd74ca8c0cbeb, NAME => 'testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 4796dff8992ae0816c515956a8e0eae1, NAME => 'testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b2de3b9bcecdb49123cc636ca7bf881a, NAME => 'testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.', STARTKEY => '1', ENDKEY => '2'}] 2023-02-07 16:57:44,403 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789064402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789064402"}]},"ts":"1675789064402"} 2023-02-07 16:57:44,403 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789064402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789064402"}]},"ts":"1675789064402"} 2023-02-07 16:57:44,403 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789064402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789064402"}]},"ts":"1675789064402"} 2023-02-07 16:57:44,404 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-07 16:57:44,404 INFO [PEWorker-1] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-07 16:57:44,404 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 3ff1b383efaf25127b1cd74ca8c0cbeb, NAME => 'testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 4796dff8992ae0816c515956a8e0eae1, NAME => 'testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b2de3b9bcecdb49123cc636ca7bf881a, NAME => 'testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.', STARTKEY => '1', ENDKEY => '2'}] 2023-02-07 16:57:44,405 INFO [PEWorker-1] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1675789047827 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-07 16:57:44,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675789047827" table: "testCompactionWithHFileLink" creation_time: 1675789047835 type: FLUSH version: 2 ttl: 0 ) in 531 msec 2023-02-07 16:57:44,491 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:44,491 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:44,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-07 16:57:44,494 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-07 16:57:44,494 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1675789047827-1675789061705 2023-02-07 16:57:44,496 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:44,496 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:44,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(748): Client=jenkins//136.243.104.168 delete name: "hbase-failsafe-snaptb-1675789047827-1675789061705" 2023-02-07 16:57:44,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1675789047827-1675789061705 2023-02-07 16:57:44,510 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:44,511 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:44,511 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-07 16:57:44,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$10(2372): Client=jenkins//136.243.104.168 enable testCompactionWithHFileLink 2023-02-07 16:57:44,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-07 16:57:44,524 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:44,524 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:44,524 INFO [PEWorker-5] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-07 16:57:44,525 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789064524"}]},"ts":"1675789064524"} 2023-02-07 16:57:44,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-07 16:57:44,526 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-07 16:57:44,600 DEBUG [PEWorker-5] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-07 16:57:44,600 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, ASSIGN}] 2023-02-07 16:57:44,603 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, ASSIGN 2023-02-07 16:57:44,603 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, ASSIGN 2023-02-07 16:57:44,603 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, ASSIGN 2023-02-07 16:57:44,604 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-07 16:57:44,604 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-07 16:57:44,604 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-07 16:57:44,625 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:44,625 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:44,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-07 16:57:44,758 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3ff1b383efaf25127b1cd74ca8c0cbeb, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:44,758 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=4796dff8992ae0816c515956a8e0eae1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:44,758 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789064757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789064757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789064757"}]},"ts":"1675789064757"} 2023-02-07 16:57:44,758 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789064758"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789064758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789064758"}]},"ts":"1675789064758"} 2023-02-07 16:57:44,758 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=b2de3b9bcecdb49123cc636ca7bf881a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:44,758 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789064758"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789064758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789064758"}]},"ts":"1675789064758"} 2023-02-07 16:57:44,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 3ff1b383efaf25127b1cd74ca8c0cbeb, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:44,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 4796dff8992ae0816c515956a8e0eae1, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:44,763 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure b2de3b9bcecdb49123cc636ca7bf881a, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:44,828 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:44,828 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:44,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-07 16:57:44,917 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:44,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4796dff8992ae0816c515956a8e0eae1, NAME => 'testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.', STARTKEY => '', ENDKEY => '1'} 2023-02-07 16:57:44,917 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:44,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,918 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,920 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,921 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1 2023-02-07 16:57:44,921 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1 2023-02-07 16:57:44,922 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4796dff8992ae0816c515956a8e0eae1 columnFamilyName family1 2023-02-07 16:57:44,943 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-362996dbff474ce2af5b79928b7220ba 2023-02-07 16:57:44,948 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-45a160c072814a38a272a04e6d834061 2023-02-07 16:57:44,953 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-6554a0b5611642b38c5d3d014fc4093b 2023-02-07 16:57:44,959 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7ef6a4deeb6e414e8b89cdac5ec39874 2023-02-07 16:57:44,959 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(310): Store=4796dff8992ae0816c515956a8e0eae1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:44,959 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,960 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2 2023-02-07 16:57:44,960 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2 2023-02-07 16:57:44,961 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4796dff8992ae0816c515956a8e0eae1 columnFamilyName family2 2023-02-07 16:57:44,969 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-54c1e42d1e5d4926bbb7e2b5837a7467 2023-02-07 16:57:44,976 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7688d830bdaa4e118fc5b9ecb03c11dc 2023-02-07 16:57:44,983 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-ba63c6e9b5e740b6af1809b59061b847 2023-02-07 16:57:44,989 DEBUG [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-cb033056a24e462990e5bd567722e775 2023-02-07 16:57:44,990 INFO [StoreOpener-4796dff8992ae0816c515956a8e0eae1-1] regionserver.HStore(310): Store=4796dff8992ae0816c515956a8e0eae1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:44,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:44,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:57:44,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 4796dff8992ae0816c515956a8e0eae1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59021232, jitterRate=-0.12051510810852051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:44,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 4796dff8992ae0816c515956a8e0eae1: Running coprocessor pre-open hook at 1675789064918Writing region info on filesystem at 1675789064918Initializing all the Stores at 1675789064919 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789064919Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789064920 (+1 ms)Cleaning up temporary data from old regions at 1675789064992 (+72 ms)Cleaning up detritus from prior splits at 1675789064992Running coprocessor post-open hooks at 1675789064994 (+2 ms)Region opened successfully at 1675789064994 2023-02-07 16:57:44,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1., pid=102, masterSystemTime=1675789064913 2023-02-07 16:57:44,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:44,996 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-07 16:57:44,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:44,996 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-07 16:57:44,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:44,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:44,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b2de3b9bcecdb49123cc636ca7bf881a, NAME => 'testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.', STARTKEY => '1', ENDKEY => '2'} 2023-02-07 16:57:44,998 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=4796dff8992ae0816c515956a8e0eae1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:44,998 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789064998"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789064998"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789064998"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789064998"}]},"ts":"1675789064998"} 2023-02-07 16:57:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:44,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:44,999 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-07 16:57:44,999 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:44,999 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1912): 4796dff8992ae0816c515956a8e0eae1/family2 is initiating minor compaction (all files) 2023-02-07 16:57:44,999 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-07 16:57:45,000 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 4796dff8992ae0816c515956a8e0eae1/family2 in testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:45,000 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1912): 4796dff8992ae0816c515956a8e0eae1/family1 is initiating minor compaction (all files) 2023-02-07 16:57:45,000 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7688d830bdaa4e118fc5b9ecb03c11dc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-ba63c6e9b5e740b6af1809b59061b847, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-54c1e42d1e5d4926bbb7e2b5837a7467, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-cb033056a24e462990e5bd567722e775] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp, totalSize=20.4 K 2023-02-07 16:57:45,000 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 4796dff8992ae0816c515956a8e0eae1/family1 in testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:57:45,000 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-45a160c072814a38a272a04e6d834061, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7ef6a4deeb6e414e8b89cdac5ec39874, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-6554a0b5611642b38c5d3d014fc4093b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-362996dbff474ce2af5b79928b7220ba] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp, totalSize=21.6 K 2023-02-07 16:57:45,000 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1 2023-02-07 16:57:45,000 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1 2023-02-07 16:57:45,000 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7688d830bdaa4e118fc5b9ecb03c11dc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040192 2023-02-07 16:57:45,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=98 2023-02-07 16:57:45,001 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2de3b9bcecdb49123cc636ca7bf881a columnFamilyName family1 2023-02-07 16:57:45,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 4796dff8992ae0816c515956a8e0eae1, server=jenkins-hbase12.apache.org,33237,1675788923983 in 237 msec 2023-02-07 16:57:45,000 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-45a160c072814a38a272a04e6d834061, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040192 2023-02-07 16:57:45,002 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-ba63c6e9b5e740b6af1809b59061b847, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:45,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=4796dff8992ae0816c515956a8e0eae1, ASSIGN in 401 msec 2023-02-07 16:57:45,002 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7ef6a4deeb6e414e8b89cdac5ec39874, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:45,002 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-54c1e42d1e5d4926bbb7e2b5837a7467, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044335 2023-02-07 16:57:45,002 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-6554a0b5611642b38c5d3d014fc4093b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044335 2023-02-07 16:57:45,003 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-cb033056a24e462990e5bd567722e775, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046313 2023-02-07 16:57:45,003 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-362996dbff474ce2af5b79928b7220ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046313 2023-02-07 16:57:45,013 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-4bc11d1ce16b4c01b4d98beb4fcdaa7d 2023-02-07 16:57:45,022 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-92fb8344529940d8b39442ca7bfc53bd 2023-02-07 16:57:45,030 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-d60b3c69f6d2478190cc6c8eabd5958a 2023-02-07 16:57:45,033 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] throttle.PressureAwareThroughputController(145): 4796dff8992ae0816c515956a8e0eae1#family2#compaction#115 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:45,033 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 4796dff8992ae0816c515956a8e0eae1#family1#compaction#114 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:45,043 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-e13267b2867d4466844cd3f3f35c8cda 2023-02-07 16:57:45,043 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(310): Store=b2de3b9bcecdb49123cc636ca7bf881a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:45,043 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:45,044 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2 2023-02-07 16:57:45,044 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2 2023-02-07 16:57:45,044 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b2de3b9bcecdb49123cc636ca7bf881a columnFamilyName family2 2023-02-07 16:57:45,051 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-2ee4b808c376418396eb230b612c4798 2023-02-07 16:57:45,056 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-338141da13724c34a459d565dfd6e270 2023-02-07 16:57:45,060 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-6ce43f55a3004c2d9cf992f8f280d75b 2023-02-07 16:57:45,066 DEBUG [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-8139e79486ed48a5ac9e3e79b1aec530 2023-02-07 16:57:45,066 INFO [StoreOpener-b2de3b9bcecdb49123cc636ca7bf881a-1] regionserver.HStore(310): Store=b2de3b9bcecdb49123cc636ca7bf881a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:45,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:45,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:45,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:45,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:57:45,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened b2de3b9bcecdb49123cc636ca7bf881a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68895211, jitterRate=0.02661864459514618}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:45,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for b2de3b9bcecdb49123cc636ca7bf881a: Running coprocessor pre-open hook at 1675789064998Writing region info on filesystem at 1675789064998Initializing all the Stores at 1675789064999 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789064999Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789064999Cleaning up temporary data from old regions at 1675789065068 (+69 ms)Cleaning up detritus from prior splits at 1675789065068Running coprocessor post-open hooks at 1675789065070 (+2 ms)Region opened successfully at 1675789065070 2023-02-07 16:57:45,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a., pid=103, masterSystemTime=1675789064913 2023-02-07 16:57:45,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-07 16:57:45,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-07 16:57:45,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:45,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:45,072 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:45,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3ff1b383efaf25127b1cd74ca8c0cbeb, NAME => 'testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.', STARTKEY => '2', ENDKEY => ''} 2023-02-07 16:57:45,072 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=b2de3b9bcecdb49123cc636ca7bf881a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:45,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:45,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:45,073 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789065072"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789065072"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789065072"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789065072"}]},"ts":"1675789065072"} 2023-02-07 16:57:45,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:45,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:45,074 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:45,075 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1 2023-02-07 16:57:45,075 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1 2023-02-07 16:57:45,076 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ff1b383efaf25127b1cd74ca8c0cbeb columnFamilyName family1 2023-02-07 16:57:45,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=99 2023-02-07 16:57:45,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure b2de3b9bcecdb49123cc636ca7bf881a, server=jenkins-hbase12.apache.org,33237,1675788923983 in 311 msec 2023-02-07 16:57:45,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b2de3b9bcecdb49123cc636ca7bf881a, ASSIGN in 476 msec 2023-02-07 16:57:45,082 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-7c141e8341e04810aeb6e5bd3c21e0b3 2023-02-07 16:57:45,089 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8fc0c43777844ec9aa1e3a6fd3bcb170 2023-02-07 16:57:45,096 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-d3a0a5e38f2749f1829b4d1c359f31e3 2023-02-07 16:57:45,103 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-f9c14fe73c554c63994d084b3c17bb65 2023-02-07 16:57:45,103 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(310): Store=3ff1b383efaf25127b1cd74ca8c0cbeb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:45,103 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:45,104 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2 2023-02-07 16:57:45,104 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2 2023-02-07 16:57:45,104 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ff1b383efaf25127b1cd74ca8c0cbeb columnFamilyName family2 2023-02-07 16:57:45,112 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-558aebd4298e4050b4a6e60c0079d521 2023-02-07 16:57:45,119 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-80506a2b80794344a71e5da1214aaa5e 2023-02-07 16:57:45,125 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8e780a24c43a45ab991b58b69e05c0bc 2023-02-07 16:57:45,129 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:45,129 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:45,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-07 16:57:45,131 DEBUG [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-b78f87102b614fb6a0336bc1a1090857 2023-02-07 16:57:45,131 INFO [StoreOpener-3ff1b383efaf25127b1cd74ca8c0cbeb-1] regionserver.HStore(310): Store=3ff1b383efaf25127b1cd74ca8c0cbeb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:45,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:45,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:45,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:45,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:57:45,135 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 3ff1b383efaf25127b1cd74ca8c0cbeb; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60812792, jitterRate=-0.0938187837600708}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:45,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: Running coprocessor pre-open hook at 1675789065073Writing region info on filesystem at 1675789065073Initializing all the Stores at 1675789065074 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789065074Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789065074Cleaning up temporary data from old regions at 1675789065133 (+59 ms)Cleaning up detritus from prior splits at 1675789065133Running coprocessor post-open hooks at 1675789065135 (+2 ms)Region opened successfully at 1675789065135 2023-02-07 16:57:45,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb., pid=101, masterSystemTime=1675789064913 2023-02-07 16:57:45,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-07 16:57:45,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-07 16:57:45,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:45,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:45,138 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3ff1b383efaf25127b1cd74ca8c0cbeb, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:45,138 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675789065138"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789065138"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789065138"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789065138"}]},"ts":"1675789065138"} 2023-02-07 16:57:45,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=100 2023-02-07 16:57:45,141 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 3ff1b383efaf25127b1cd74ca8c0cbeb, server=jenkins-hbase12.apache.org,33237,1675788923983 in 378 msec 2023-02-07 16:57:45,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=97 2023-02-07 16:57:45,142 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=3ff1b383efaf25127b1cd74ca8c0cbeb, ASSIGN in 541 msec 2023-02-07 16:57:45,143 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789065142"}]},"ts":"1675789065142"} 2023-02-07 16:57:45,144 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-07 16:57:45,155 INFO [PEWorker-5] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-07 16:57:45,156 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 639 msec 2023-02-07 16:57:45,630 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:45,631 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:45,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-07 16:57:45,632 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-07 16:57:45,643 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:45,652 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:45,662 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:45,662 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:45,669 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-07 16:57:45,682 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-07 16:57:45,682 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:45,682 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ReadOnlyZKClient(139): Connect 0x6fb6674a to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:57:45,692 DEBUG [Listener at localhost.localdomain/41849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1063f655, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:57:45,693 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:45,693 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:45,693 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:46,260 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family2/dd09c5a2f72a4ebe98e9356ad51c6d68 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/dd09c5a2f72a4ebe98e9356ad51c6d68 2023-02-07 16:57:46,265 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/.tmp/family1/564edd1f973c487c930123de5933077a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/564edd1f973c487c930123de5933077a 2023-02-07 16:57:46,271 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-07 16:57:46,272 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 4796dff8992ae0816c515956a8e0eae1/family2 of 4796dff8992ae0816c515956a8e0eae1 into dd09c5a2f72a4ebe98e9356ad51c6d68(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:46,272 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:46,272 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1., storeName=4796dff8992ae0816c515956a8e0eae1/family2, priority=12, startTime=1675789064996; duration=1sec 2023-02-07 16:57:46,272 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-07 16:57:46,273 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-07 16:57:46,277 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 4796dff8992ae0816c515956a8e0eae1/family1 of 4796dff8992ae0816c515956a8e0eae1 into 564edd1f973c487c930123de5933077a(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:46,277 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:46,277 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1., storeName=4796dff8992ae0816c515956a8e0eae1/family1, priority=12, startTime=1675789064995; duration=1sec 2023-02-07 16:57:46,277 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-07 16:57:46,286 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-07 16:57:46,286 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-07 16:57:46,287 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1912): b2de3b9bcecdb49123cc636ca7bf881a/family1 is initiating minor compaction (all files) 2023-02-07 16:57:46,287 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegion(2258): Starting compaction of b2de3b9bcecdb49123cc636ca7bf881a/family1 in testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:46,287 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-d60b3c69f6d2478190cc6c8eabd5958a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-92fb8344529940d8b39442ca7bfc53bd, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-e13267b2867d4466844cd3f3f35c8cda, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-4bc11d1ce16b4c01b4d98beb4fcdaa7d] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp, totalSize=21.6 K 2023-02-07 16:57:46,288 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-d60b3c69f6d2478190cc6c8eabd5958a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040193 2023-02-07 16:57:46,289 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-92fb8344529940d8b39442ca7bfc53bd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:46,290 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-e13267b2867d4466844cd3f3f35c8cda, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044335 2023-02-07 16:57:46,291 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-07 16:57:46,291 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1912): 3ff1b383efaf25127b1cd74ca8c0cbeb/family2 is initiating minor compaction (all files) 2023-02-07 16:57:46,291 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 3ff1b383efaf25127b1cd74ca8c0cbeb/family2 in testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:46,291 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-80506a2b80794344a71e5da1214aaa5e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8e780a24c43a45ab991b58b69e05c0bc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-558aebd4298e4050b4a6e60c0079d521, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-b78f87102b614fb6a0336bc1a1090857] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp, totalSize=20.4 K 2023-02-07 16:57:46,291 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-4bc11d1ce16b4c01b4d98beb4fcdaa7d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046314 2023-02-07 16:57:46,294 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-80506a2b80794344a71e5da1214aaa5e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040193 2023-02-07 16:57:46,295 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8e780a24c43a45ab991b58b69e05c0bc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:46,296 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-558aebd4298e4050b4a6e60c0079d521, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044336 2023-02-07 16:57:46,300 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-b78f87102b614fb6a0336bc1a1090857, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046314 2023-02-07 16:57:46,317 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] throttle.PressureAwareThroughputController(145): b2de3b9bcecdb49123cc636ca7bf881a#family1#compaction#116 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:46,319 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): 3ff1b383efaf25127b1cd74ca8c0cbeb#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:46,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-45a160c072814a38a272a04e6d834061, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7ef6a4deeb6e414e8b89cdac5ec39874, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-6554a0b5611642b38c5d3d014fc4093b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-362996dbff474ce2af5b79928b7220ba] to archive 2023-02-07 16:57:46,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:46,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-45a160c072814a38a272a04e6d834061 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-45a160c072814a38a272a04e6d834061 2023-02-07 16:57:46,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7ef6a4deeb6e414e8b89cdac5ec39874 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7ef6a4deeb6e414e8b89cdac5ec39874 2023-02-07 16:57:46,360 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-6554a0b5611642b38c5d3d014fc4093b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-6554a0b5611642b38c5d3d014fc4093b 2023-02-07 16:57:46,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-362996dbff474ce2af5b79928b7220ba to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-362996dbff474ce2af5b79928b7220ba 2023-02-07 16:57:46,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7688d830bdaa4e118fc5b9ecb03c11dc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-ba63c6e9b5e740b6af1809b59061b847, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-54c1e42d1e5d4926bbb7e2b5837a7467, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-cb033056a24e462990e5bd567722e775] to archive 2023-02-07 16:57:46,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:46,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7688d830bdaa4e118fc5b9ecb03c11dc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-7688d830bdaa4e118fc5b9ecb03c11dc 2023-02-07 16:57:46,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-ba63c6e9b5e740b6af1809b59061b847 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-ba63c6e9b5e740b6af1809b59061b847 2023-02-07 16:57:46,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-54c1e42d1e5d4926bbb7e2b5837a7467 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-54c1e42d1e5d4926bbb7e2b5837a7467 2023-02-07 16:57:46,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-cb033056a24e462990e5bd567722e775 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family2/testCompactionWithHFileLink=4796dff8992ae0816c515956a8e0eae1-cb033056a24e462990e5bd567722e775 2023-02-07 16:57:46,584 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302072f384f1d63dd441dbc298da3862eaf4e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302072f384f1d63dd441dbc298da3862eaf4e 2023-02-07 16:57:46,584 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302074552093fea6d44898430be75747e4a40 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302074552093fea6d44898430be75747e4a40 2023-02-07 16:57:46,584 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020786674b9f190d4e589fb0f7eed8d18e1f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020786674b9f190d4e589fb0f7eed8d18e1f 2023-02-07 16:57:46,585 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:46,585 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:46,585 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:46,597 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:57:46,600 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:54626, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:57:46,615 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,615 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,615 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,615 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,616 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:57:46,619 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46072, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:57:46,619 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,619 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:46,620 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,620 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:46,643 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207/family1/11cc8404e49b4f21bcfa7208c9ec00f6 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-07 16:57:46,643 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207/family1/2e230cf6b37642d9918b2ef56adaa4a0 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-07 16:57:46,643 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207/family1/e407b767c27a4b758c62eab8ea276edf first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-07 16:57:46,644 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207/family1/11cc8404e49b4f21bcfa7208c9ec00f6}] 2023-02-07 16:57:46,644 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207/family1/e407b767c27a4b758c62eab8ea276edf}] 2023-02-07 16:57:46,644 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207/family1/2e230cf6b37642d9918b2ef56adaa4a0}] 2023-02-07 16:57:46,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207/family1/2e230cf6b37642d9918b2ef56adaa4a0 for inclusion in 4796dff8992ae0816c515956a8e0eae1/family1 2023-02-07 16:57:46,653 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207/family1/11cc8404e49b4f21bcfa7208c9ec00f6 for inclusion in b2de3b9bcecdb49123cc636ca7bf881a/family1 2023-02-07 16:57:46,653 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207/family1/e407b767c27a4b758c62eab8ea276edf for inclusion in 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 2023-02-07 16:57:46,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-07 16:57:46,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last=1 2023-02-07 16:57:46,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 4796dff8992ae0816c515956a8e0eae1: 2023-02-07 16:57:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-07 16:57:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-07 16:57:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-07 16:57:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-07 16:57:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:46,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207/family1/e407b767c27a4b758c62eab8ea276edf to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__ens3992it8vh5a0hhf7fttpls9cucblu2tjrrdb8c4igj7nsd4383q5fj1kocrud/family1/e407b767c27a4b758c62eab8ea276edf 2023-02-07 16:57:46,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207/family1/2e230cf6b37642d9918b2ef56adaa4a0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__a4nu8mtjn3qnjjq9t49cnobmbju5afnoojuf00c4pqoutm9q8m19g2tuedhktd5s/family1/2e230cf6b37642d9918b2ef56adaa4a0 2023-02-07 16:57:46,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207/family1/11cc8404e49b4f21bcfa7208c9ec00f6 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__7dt2ispkpgvprclnhq5g1tn0ocdbpruo09cd4drdlm8f8cb9l8ucd3529hp9t088/family1/11cc8404e49b4f21bcfa7208c9ec00f6 2023-02-07 16:57:46,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__7dt2ispkpgvprclnhq5g1tn0ocdbpruo09cd4drdlm8f8cb9l8ucd3529hp9t088/family1/11cc8404e49b4f21bcfa7208c9ec00f6 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/a34e850d4a7947de93fa9640905b5f81_SeqId_34_ 2023-02-07 16:57:46,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__ens3992it8vh5a0hhf7fttpls9cucblu2tjrrdb8c4igj7nsd4383q5fj1kocrud/family1/e407b767c27a4b758c62eab8ea276edf as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/09fec9748fbe43d4944a60924fd5aa65_SeqId_34_ 2023-02-07 16:57:46,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__a4nu8mtjn3qnjjq9t49cnobmbju5afnoojuf00c4pqoutm9q8m19g2tuedhktd5s/family1/2e230cf6b37642d9918b2ef56adaa4a0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/776924a915b7468fa439908f5d1d6fa0_SeqId_36_ 2023-02-07 16:57:46,661 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__7dt2ispkpgvprclnhq5g1tn0ocdbpruo09cd4drdlm8f8cb9l8ucd3529hp9t088/family1/11cc8404e49b4f21bcfa7208c9ec00f6 into b2de3b9bcecdb49123cc636ca7bf881a/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/a34e850d4a7947de93fa9640905b5f81_SeqId_34_ - updating store file list. 2023-02-07 16:57:46,661 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__ens3992it8vh5a0hhf7fttpls9cucblu2tjrrdb8c4igj7nsd4383q5fj1kocrud/family1/e407b767c27a4b758c62eab8ea276edf into 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/09fec9748fbe43d4944a60924fd5aa65_SeqId_34_ - updating store file list. 2023-02-07 16:57:46,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__a4nu8mtjn3qnjjq9t49cnobmbju5afnoojuf00c4pqoutm9q8m19g2tuedhktd5s/family1/2e230cf6b37642d9918b2ef56adaa4a0 into 4796dff8992ae0816c515956a8e0eae1/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/776924a915b7468fa439908f5d1d6fa0_SeqId_36_ - updating store file list. 2023-02-07 16:57:46,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/776924a915b7468fa439908f5d1d6fa0_SeqId_36_ into 4796dff8992ae0816c515956a8e0eae1/family1 2023-02-07 16:57:46,665 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/a34e850d4a7947de93fa9640905b5f81_SeqId_34_ into b2de3b9bcecdb49123cc636ca7bf881a/family1 2023-02-07 16:57:46,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/09fec9748fbe43d4944a60924fd5aa65_SeqId_34_ into 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 2023-02-07 16:57:46,665 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__7dt2ispkpgvprclnhq5g1tn0ocdbpruo09cd4drdlm8f8cb9l8ucd3529hp9t088/family1/11cc8404e49b4f21bcfa7208c9ec00f6 into b2de3b9bcecdb49123cc636ca7bf881a/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/a34e850d4a7947de93fa9640905b5f81_SeqId_34_) 2023-02-07 16:57:46,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__a4nu8mtjn3qnjjq9t49cnobmbju5afnoojuf00c4pqoutm9q8m19g2tuedhktd5s/family1/2e230cf6b37642d9918b2ef56adaa4a0 into 4796dff8992ae0816c515956a8e0eae1/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/family1/776924a915b7468fa439908f5d1d6fa0_SeqId_36_) 2023-02-07 16:57:46,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__ens3992it8vh5a0hhf7fttpls9cucblu2tjrrdb8c4igj7nsd4383q5fj1kocrud/family1/e407b767c27a4b758c62eab8ea276edf into 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/09fec9748fbe43d4944a60924fd5aa65_SeqId_34_) 2023-02-07 16:57:46,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__7dt2ispkpgvprclnhq5g1tn0ocdbpruo09cd4drdlm8f8cb9l8ucd3529hp9t088/family1/11cc8404e49b4f21bcfa7208c9ec00f6 2023-02-07 16:57:46,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__a4nu8mtjn3qnjjq9t49cnobmbju5afnoojuf00c4pqoutm9q8m19g2tuedhktd5s/family1/2e230cf6b37642d9918b2ef56adaa4a0 2023-02-07 16:57:46,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testCompactionWithHFileLink__ens3992it8vh5a0hhf7fttpls9cucblu2tjrrdb8c4igj7nsd4383q5fj1kocrud/family1/e407b767c27a4b758c62eab8ea276edf 2023-02-07 16:57:46,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:46,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-07 16:57:46,669 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:46,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(1912): 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 is initiating minor compaction (all files) 2023-02-07 16:57:46,669 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:46,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@55e98e8f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-07 16:57:46,669 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:46,670 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:46,670 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302071afe92b62214408dbc8a37c1279c4c78 2023-02-07 16:57:46,671 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:46,671 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:46,671 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302073571a98804724a4a9b34967cfc13fc81 2023-02-07 16:57:46,672 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020782852fcc8d2b4e2aa7a128350d411f64 2023-02-07 16:57:46,672 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230207544b49d8728e4aeb8a769e7ac29f2bbb 2023-02-07 16:57:46,673 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020783766f69b3054b129149d89374e5df4a 2023-02-07 16:57:46,673 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230207cb8018ec20614259acb0dcdaeb6fdf7a 2023-02-07 16:57:46,673 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230207f4a7d6d5afe342cb8a15e7be3636849f 2023-02-07 16:57:46,673 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20230207f1b702f66fe34491941e63ab53aea317 2023-02-07 16:57:46,673 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-07 16:57:46,673 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230207dd307bbaf059405f86cb1dde92c0fbec 2023-02-07 16:57:46,673 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230207' 2023-02-07 16:57:46,674 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:46,674 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230207fd281e00e9c049f699d32db0cb692111 2023-02-07 16:57:46,674 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-07 16:57:46,674 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230207' 2023-02-07 16:57:46,674 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:46,674 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230207f043a793c00e46f29c53ece3c368e541 2023-02-07 16:57:46,675 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230207f1cd34b47385498ba790217fe1e40e82 2023-02-07 16:57:46,675 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-07 16:57:46,675 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230207' 2023-02-07 16:57:46,675 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230207 for table='testCompactionWithHFileLink' and column='family1' 2023-02-07 16:57:46,676 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-07 16:57:46,679 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:46,681 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:46,684 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:46,685 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:46,690 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:46,691 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:46,706 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=283 (was 238) - Thread LEAK? -, OpenFileDescriptor=750 (was 603) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=160 (was 204), ProcessCount=174 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=2220 (was 3016) 2023-02-07 16:57:46,717 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=283, OpenFileDescriptor=750, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=174, AvailableMemoryMB=2220 2023-02-07 16:57:46,718 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,719 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:46,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$15(2997): Client=jenkins//136.243.104.168 creating {NAME => 'ns'} 2023-02-07 16:57:46,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-07 16:57:46,729 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,729 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:46,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-07 16:57:46,734 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-07 16:57:46,746 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 21 msec 2023-02-07 16:57:46,830 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,830 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:46,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-07 16:57:46,832 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,832 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:46,833 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-07 16:57:46,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-07 16:57:46,836 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:57:46,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-07 16:57:46,836 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,836 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:46,836 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:57:46,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-07 16:57:46,838 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:46,838 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:46,841 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26 empty. 2023-02-07 16:57:46,841 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:46,841 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85 empty. 2023-02-07 16:57:46,841 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:46,841 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f empty. 2023-02-07 16:57:46,841 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:46,841 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:46,842 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-07 16:57:46,937 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:46,937 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:46,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-07 16:57:47,109 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:57:47,140 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:47,140 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:47,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-07 16:57:47,250 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-07 16:57:47,252 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => d7073c73c9022e4ca4b7f790b115fb26, NAME => 'ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:57:47,253 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => d4808dee17e59026f0dbc8ffe25e685f, NAME => 'ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:57:47,253 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 4744f35850a224eccfa1a64842abbd85, NAME => 'ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:57:47,441 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:47,442 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:47,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-07 16:57:47,538 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family1/acf1e5a9f44445bc8e64d41ca8f27cae as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/acf1e5a9f44445bc8e64d41ca8f27cae 2023-02-07 16:57:47,538 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family2/1bf91c9f3366481981b0ce8684aa9756 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/1bf91c9f3366481981b0ce8684aa9756 2023-02-07 16:57:47,543 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b2de3b9bcecdb49123cc636ca7bf881a/family1 of b2de3b9bcecdb49123cc636ca7bf881a into acf1e5a9f44445bc8e64d41ca8f27cae(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:47,543 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:47,543 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 3ff1b383efaf25127b1cd74ca8c0cbeb/family2 of 3ff1b383efaf25127b1cd74ca8c0cbeb into 1bf91c9f3366481981b0ce8684aa9756(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:47,543 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a., storeName=b2de3b9bcecdb49123cc636ca7bf881a/family1, priority=12, startTime=1675789065071; duration=1sec 2023-02-07 16:57:47,543 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:47,543 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb., storeName=3ff1b383efaf25127b1cd74ca8c0cbeb/family2, priority=12, startTime=1675789065136; duration=1sec 2023-02-07 16:57:47,543 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-07 16:57:47,543 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-07 16:57:47,543 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 in testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:57:47,543 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-02-07 16:57:47,543 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-07 16:57:47,544 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-07 16:57:47,544 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. because compaction request was cancelled 2023-02-07 16:57:47,544 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-07 16:57:47,544 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8fc0c43777844ec9aa1e3a6fd3bcb170, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-7c141e8341e04810aeb6e5bd3c21e0b3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-f9c14fe73c554c63994d084b3c17bb65, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-d3a0a5e38f2749f1829b4d1c359f31e3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/09fec9748fbe43d4944a60924fd5aa65_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp, totalSize=28.9 K 2023-02-07 16:57:47,544 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8fc0c43777844ec9aa1e3a6fd3bcb170, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040193 2023-02-07 16:57:47,545 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-7c141e8341e04810aeb6e5bd3c21e0b3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:47,545 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-f9c14fe73c554c63994d084b3c17bb65, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044336 2023-02-07 16:57:47,546 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-07 16:57:47,546 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-d3a0a5e38f2749f1829b4d1c359f31e3, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046314 2023-02-07 16:57:47,546 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1912): b2de3b9bcecdb49123cc636ca7bf881a/family2 is initiating minor compaction (all files) 2023-02-07 16:57:47,546 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of b2de3b9bcecdb49123cc636ca7bf881a/family2 in testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:57:47,546 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] compactions.Compactor(207): Compacting 09fec9748fbe43d4944a60924fd5aa65_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1675789040193 2023-02-07 16:57:47,546 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-2ee4b808c376418396eb230b612c4798, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-8139e79486ed48a5ac9e3e79b1aec530, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-338141da13724c34a459d565dfd6e270, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-6ce43f55a3004c2d9cf992f8f280d75b] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp, totalSize=20.4 K 2023-02-07 16:57:47,547 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-2ee4b808c376418396eb230b612c4798, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789040193 2023-02-07 16:57:47,548 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-8139e79486ed48a5ac9e3e79b1aec530, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789042353 2023-02-07 16:57:47,548 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-338141da13724c34a459d565dfd6e270, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789044335 2023-02-07 16:57:47,549 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-6ce43f55a3004c2d9cf992f8f280d75b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789046314 2023-02-07 16:57:47,558 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] throttle.PressureAwareThroughputController(145): 3ff1b383efaf25127b1cd74ca8c0cbeb#family1#compaction#118 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:47,558 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): b2de3b9bcecdb49123cc636ca7bf881a#family2#compaction#119 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:47,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-80506a2b80794344a71e5da1214aaa5e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8e780a24c43a45ab991b58b69e05c0bc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-558aebd4298e4050b4a6e60c0079d521, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-b78f87102b614fb6a0336bc1a1090857] to archive 2023-02-07 16:57:47,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:47,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-80506a2b80794344a71e5da1214aaa5e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-80506a2b80794344a71e5da1214aaa5e 2023-02-07 16:57:47,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8e780a24c43a45ab991b58b69e05c0bc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8e780a24c43a45ab991b58b69e05c0bc 2023-02-07 16:57:47,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-558aebd4298e4050b4a6e60c0079d521 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-558aebd4298e4050b4a6e60c0079d521 2023-02-07 16:57:47,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-b78f87102b614fb6a0336bc1a1090857 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family2/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-b78f87102b614fb6a0336bc1a1090857 2023-02-07 16:57:47,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-d60b3c69f6d2478190cc6c8eabd5958a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-92fb8344529940d8b39442ca7bfc53bd, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-e13267b2867d4466844cd3f3f35c8cda, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-4bc11d1ce16b4c01b4d98beb4fcdaa7d] to archive 2023-02-07 16:57:47,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:47,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-d60b3c69f6d2478190cc6c8eabd5958a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-d60b3c69f6d2478190cc6c8eabd5958a 2023-02-07 16:57:47,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-92fb8344529940d8b39442ca7bfc53bd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-92fb8344529940d8b39442ca7bfc53bd 2023-02-07 16:57:47,571 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-e13267b2867d4466844cd3f3f35c8cda to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-e13267b2867d4466844cd3f3f35c8cda 2023-02-07 16:57:47,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-4bc11d1ce16b4c01b4d98beb4fcdaa7d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family1/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-4bc11d1ce16b4c01b4d98beb4fcdaa7d 2023-02-07 16:57:47,659 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:47,659 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:47,659 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:47,659 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing d7073c73c9022e4ca4b7f790b115fb26, disabling compactions & flushes 2023-02-07 16:57:47,659 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 4744f35850a224eccfa1a64842abbd85, disabling compactions & flushes 2023-02-07 16:57:47,660 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:47,659 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:47,659 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing d4808dee17e59026f0dbc8ffe25e685f, disabling compactions & flushes 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. after waiting 0 ms 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. after waiting 0 ms 2023-02-07 16:57:47,660 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:47,660 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for d7073c73c9022e4ca4b7f790b115fb26: Waiting for close lock at 1675789067659Disabling compacts and flushes for region at 1675789067659Disabling writes for close at 1675789067660 (+1 ms)Writing region close event to WAL at 1675789067660Closed at 1675789067660 2023-02-07 16:57:47,660 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. after waiting 0 ms 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 4744f35850a224eccfa1a64842abbd85: Waiting for close lock at 1675789067659Disabling compacts and flushes for region at 1675789067659Disabling writes for close at 1675789067660 (+1 ms)Writing region close event to WAL at 1675789067660Closed at 1675789067660 2023-02-07 16:57:47,660 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:47,660 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:47,661 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for d4808dee17e59026f0dbc8ffe25e685f: Waiting for close lock at 1675789067659Disabling compacts and flushes for region at 1675789067659Disabling writes for close at 1675789067660 (+1 ms)Writing region close event to WAL at 1675789067660Closed at 1675789067660 2023-02-07 16:57:47,663 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:57:47,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675789067664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789067664"}]},"ts":"1675789067664"} 2023-02-07 16:57:47,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675789067664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789067664"}]},"ts":"1675789067664"} 2023-02-07 16:57:47,664 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675789067664"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789067664"}]},"ts":"1675789067664"} 2023-02-07 16:57:47,666 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-07 16:57:47,667 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:57:47,667 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789067667"}]},"ts":"1675789067667"} 2023-02-07 16:57:47,668 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-07 16:57:47,692 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d7073c73c9022e4ca4b7f790b115fb26, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4744f35850a224eccfa1a64842abbd85, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d4808dee17e59026f0dbc8ffe25e685f, ASSIGN}] 2023-02-07 16:57:47,695 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d4808dee17e59026f0dbc8ffe25e685f, ASSIGN 2023-02-07 16:57:47,695 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d7073c73c9022e4ca4b7f790b115fb26, ASSIGN 2023-02-07 16:57:47,695 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4744f35850a224eccfa1a64842abbd85, ASSIGN 2023-02-07 16:57:47,696 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d4808dee17e59026f0dbc8ffe25e685f, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:57:47,696 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4744f35850a224eccfa1a64842abbd85, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:57:47,696 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d7073c73c9022e4ca4b7f790b115fb26, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:57:47,849 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=d4808dee17e59026f0dbc8ffe25e685f, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:47,849 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4744f35850a224eccfa1a64842abbd85, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:47,849 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d7073c73c9022e4ca4b7f790b115fb26, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:47,850 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675789067849"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789067849"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789067849"}]},"ts":"1675789067849"} 2023-02-07 16:57:47,850 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675789067849"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789067849"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789067849"}]},"ts":"1675789067849"} 2023-02-07 16:57:47,850 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675789067849"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789067849"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789067849"}]},"ts":"1675789067849"} 2023-02-07 16:57:47,852 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure d4808dee17e59026f0dbc8ffe25e685f, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:47,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure d7073c73c9022e4ca4b7f790b115fb26, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:47,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 4744f35850a224eccfa1a64842abbd85, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:57:47,943 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:47,944 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:47,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-07 16:57:47,978 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/.tmp/family1/9dca73f3d74940cc9641da5bc2ef2197 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/9dca73f3d74940cc9641da5bc2ef2197 2023-02-07 16:57:47,985 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 3ff1b383efaf25127b1cd74ca8c0cbeb/family1 of 3ff1b383efaf25127b1cd74ca8c0cbeb into 9dca73f3d74940cc9641da5bc2ef2197(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:57:47,985 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: 2023-02-07 16:57:47,985 INFO [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1675789066669; duration=0sec 2023-02-07 16:57:47,985 DEBUG [RS:0;jenkins-hbase12:33237-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:48,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:48,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d4808dee17e59026f0dbc8ffe25e685f, NAME => 'ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f.', STARTKEY => '2', ENDKEY => ''} 2023-02-07 16:57:48,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:48,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:48,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:48,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:48,008 INFO [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:48,009 DEBUG [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1 2023-02-07 16:57:48,009 DEBUG [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1 2023-02-07 16:57:48,010 INFO [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4808dee17e59026f0dbc8ffe25e685f columnFamilyName family1 2023-02-07 16:57:48,010 INFO [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] regionserver.HStore(310): Store=d4808dee17e59026f0dbc8ffe25e685f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:48,011 INFO [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:48,011 DEBUG [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2 2023-02-07 16:57:48,012 DEBUG [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2 2023-02-07 16:57:48,012 INFO [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d4808dee17e59026f0dbc8ffe25e685f columnFamilyName family2 2023-02-07 16:57:48,013 INFO [StoreOpener-d4808dee17e59026f0dbc8ffe25e685f-1] regionserver.HStore(310): Store=d4808dee17e59026f0dbc8ffe25e685f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:48,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:48,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:48,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:48,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:57:48,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:57:48,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened d4808dee17e59026f0dbc8ffe25e685f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69495872, jitterRate=0.035569190979003906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:48,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for d4808dee17e59026f0dbc8ffe25e685f: Running coprocessor pre-open hook at 1675789068007Writing region info on filesystem at 1675789068007Initializing all the Stores at 1675789068008 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789068008Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789068008Cleaning up temporary data from old regions at 1675789068014 (+6 ms)Cleaning up detritus from prior splits at 1675789068014Running coprocessor post-open hooks at 1675789068018 (+4 ms)Region opened successfully at 1675789068018 2023-02-07 16:57:48,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f., pid=109, masterSystemTime=1675789068005 2023-02-07 16:57:48,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:48,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:48,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d7073c73c9022e4ca4b7f790b115fb26, NAME => 'ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26.', STARTKEY => '', ENDKEY => '1'} 2023-02-07 16:57:48,020 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=d4808dee17e59026f0dbc8ffe25e685f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:48,020 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675789068020"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789068020"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789068020"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789068020"}]},"ts":"1675789068020"} 2023-02-07 16:57:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:48,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:48,021 INFO [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:48,022 DEBUG [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1 2023-02-07 16:57:48,022 DEBUG [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1 2023-02-07 16:57:48,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-02-07 16:57:48,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure d4808dee17e59026f0dbc8ffe25e685f, server=jenkins-hbase12.apache.org,33237,1675788923983 in 169 msec 2023-02-07 16:57:48,023 INFO [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7073c73c9022e4ca4b7f790b115fb26 columnFamilyName family1 2023-02-07 16:57:48,023 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d4808dee17e59026f0dbc8ffe25e685f, ASSIGN in 330 msec 2023-02-07 16:57:48,023 INFO [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] regionserver.HStore(310): Store=d7073c73c9022e4ca4b7f790b115fb26/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:48,024 INFO [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:48,024 DEBUG [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2 2023-02-07 16:57:48,024 DEBUG [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2 2023-02-07 16:57:48,025 INFO [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7073c73c9022e4ca4b7f790b115fb26 columnFamilyName family2 2023-02-07 16:57:48,025 INFO [StoreOpener-d7073c73c9022e4ca4b7f790b115fb26-1] regionserver.HStore(310): Store=d7073c73c9022e4ca4b7f790b115fb26/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:48,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:48,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:48,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:48,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:57:48,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:57:48,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened d7073c73c9022e4ca4b7f790b115fb26; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65416714, jitterRate=-0.02521499991416931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:48,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for d7073c73c9022e4ca4b7f790b115fb26: Running coprocessor pre-open hook at 1675789068020Writing region info on filesystem at 1675789068020Initializing all the Stores at 1675789068021 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789068021Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789068021Cleaning up temporary data from old regions at 1675789068027 (+6 ms)Cleaning up detritus from prior splits at 1675789068027Running coprocessor post-open hooks at 1675789068030 (+3 ms)Region opened successfully at 1675789068030 2023-02-07 16:57:48,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26., pid=110, masterSystemTime=1675789068005 2023-02-07 16:57:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:48,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:48,032 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 4744f35850a224eccfa1a64842abbd85, NAME => 'ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85.', STARTKEY => '1', ENDKEY => '2'} 2023-02-07 16:57:48,032 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=d7073c73c9022e4ca4b7f790b115fb26, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:48,032 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675789068032"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789068032"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789068032"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789068032"}]},"ts":"1675789068032"} 2023-02-07 16:57:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:57:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:48,032 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:48,034 INFO [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:48,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-07 16:57:48,035 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure d7073c73c9022e4ca4b7f790b115fb26, server=jenkins-hbase12.apache.org,33237,1675788923983 in 180 msec 2023-02-07 16:57:48,035 DEBUG [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1 2023-02-07 16:57:48,035 DEBUG [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1 2023-02-07 16:57:48,035 INFO [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4744f35850a224eccfa1a64842abbd85 columnFamilyName family1 2023-02-07 16:57:48,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=d7073c73c9022e4ca4b7f790b115fb26, ASSIGN in 343 msec 2023-02-07 16:57:48,036 INFO [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] regionserver.HStore(310): Store=4744f35850a224eccfa1a64842abbd85/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:48,036 INFO [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:48,037 DEBUG [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2 2023-02-07 16:57:48,037 DEBUG [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2 2023-02-07 16:57:48,038 INFO [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4744f35850a224eccfa1a64842abbd85 columnFamilyName family2 2023-02-07 16:57:48,038 INFO [StoreOpener-4744f35850a224eccfa1a64842abbd85-1] regionserver.HStore(310): Store=4744f35850a224eccfa1a64842abbd85/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:57:48,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:48,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:48,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:57:48,041 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 4744f35850a224eccfa1a64842abbd85 2023-02-07 16:57:48,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:57:48,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 4744f35850a224eccfa1a64842abbd85; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71547015, jitterRate=0.06613360345363617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:57:48,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 4744f35850a224eccfa1a64842abbd85: Running coprocessor pre-open hook at 1675789068032Writing region info on filesystem at 1675789068032Initializing all the Stores at 1675789068033 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789068033Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789068033Cleaning up temporary data from old regions at 1675789068040 (+7 ms)Cleaning up detritus from prior splits at 1675789068040Running coprocessor post-open hooks at 1675789068043 (+3 ms)Region opened successfully at 1675789068043 2023-02-07 16:57:48,044 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85., pid=111, masterSystemTime=1675789068005 2023-02-07 16:57:48,045 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:48,045 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:48,045 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=4744f35850a224eccfa1a64842abbd85, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:48,045 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675789068045"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789068045"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789068045"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789068045"}]},"ts":"1675789068045"} 2023-02-07 16:57:48,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-07 16:57:48,047 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 4744f35850a224eccfa1a64842abbd85, server=jenkins-hbase12.apache.org,33237,1675788923983 in 192 msec 2023-02-07 16:57:48,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-02-07 16:57:48,048 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=4744f35850a224eccfa1a64842abbd85, ASSIGN in 355 msec 2023-02-07 16:57:48,049 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:57:48,049 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789068049"}]},"ts":"1675789068049"} 2023-02-07 16:57:48,050 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-07 16:57:48,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8fc0c43777844ec9aa1e3a6fd3bcb170, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-7c141e8341e04810aeb6e5bd3c21e0b3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-f9c14fe73c554c63994d084b3c17bb65, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-d3a0a5e38f2749f1829b4d1c359f31e3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/09fec9748fbe43d4944a60924fd5aa65_SeqId_34_] to archive 2023-02-07 16:57:48,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:48,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8fc0c43777844ec9aa1e3a6fd3bcb170 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-8fc0c43777844ec9aa1e3a6fd3bcb170 2023-02-07 16:57:48,059 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-7c141e8341e04810aeb6e5bd3c21e0b3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-7c141e8341e04810aeb6e5bd3c21e0b3 2023-02-07 16:57:48,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-f9c14fe73c554c63994d084b3c17bb65 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-f9c14fe73c554c63994d084b3c17bb65 2023-02-07 16:57:48,061 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:57:48,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-d3a0a5e38f2749f1829b4d1c359f31e3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/testCompactionWithHFileLink=3ff1b383efaf25127b1cd74ca8c0cbeb-d3a0a5e38f2749f1829b4d1c359f31e3 2023-02-07 16:57:48,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2280 sec 2023-02-07 16:57:48,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/09fec9748fbe43d4944a60924fd5aa65_SeqId_34_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/family1/09fec9748fbe43d4944a60924fd5aa65_SeqId_34_ 2023-02-07 16:57:48,793 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/.tmp/family2/f059634a85cd4a13a88db889476e65d1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/f059634a85cd4a13a88db889476e65d1 2023-02-07 16:57:48,803 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b2de3b9bcecdb49123cc636ca7bf881a/family2 of b2de3b9bcecdb49123cc636ca7bf881a into f059634a85cd4a13a88db889476e65d1(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:48,803 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for b2de3b9bcecdb49123cc636ca7bf881a: 2023-02-07 16:57:48,803 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a., storeName=b2de3b9bcecdb49123cc636ca7bf881a/family2, priority=12, startTime=1675789065071; duration=1sec 2023-02-07 16:57:48,803 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:57:48,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-2ee4b808c376418396eb230b612c4798, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-8139e79486ed48a5ac9e3e79b1aec530, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-338141da13724c34a459d565dfd6e270, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-6ce43f55a3004c2d9cf992f8f280d75b] to archive 2023-02-07 16:57:48,856 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:48,860 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-2ee4b808c376418396eb230b612c4798 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-2ee4b808c376418396eb230b612c4798 2023-02-07 16:57:48,862 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-8139e79486ed48a5ac9e3e79b1aec530 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-8139e79486ed48a5ac9e3e79b1aec530 2023-02-07 16:57:48,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-338141da13724c34a459d565dfd6e270 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-338141da13724c34a459d565dfd6e270 2023-02-07 16:57:48,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-6ce43f55a3004c2d9cf992f8f280d75b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/family2/testCompactionWithHFileLink=b2de3b9bcecdb49123cc636ca7bf881a-6ce43f55a3004c2d9cf992f8f280d75b 2023-02-07 16:57:48,946 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:48,946 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:48,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-07 16:57:48,948 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-07 16:57:48,959 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:48,960 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:48,960 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:48,963 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:48,963 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:48,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:48,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-07 16:57:48,966 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-07 16:57:48,966 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:48,966 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-07 16:57:48,966 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-07 16:57:48,967 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:48,967 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:48,986 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:48,986 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:48,987 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:48,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:48,987 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:48,987 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:48,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:48,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:48,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:48,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:48,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-07 16:57:48,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-07 16:57:48,989 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-07 16:57:48,989 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:48,989 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-07 16:57:48,989 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:48,989 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. started... 2023-02-07 16:57:48,989 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:48,989 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:48,991 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4744f35850a224eccfa1a64842abbd85 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:57:48,989 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:48,992 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. started... 2023-02-07 16:57:48,989 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:48,992 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. started... 2023-02-07 16:57:48,992 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d4808dee17e59026f0dbc8ffe25e685f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:57:48,992 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d7073c73c9022e4ca4b7f790b115fb26 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:57:49,409 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207fdf212bc735741e6a3f50a5af1706537 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230207fdf212bc735741e6a3f50a5af1706537 2023-02-07 16:57:49,410 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302076bc2978d3bad469c846c906d73903c45 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302076bc2978d3bad469c846c906d73903c45 2023-02-07 16:57:49,410 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207c2caae67a7c34794909a7d870d9c7f4a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230207c2caae67a7c34794909a7d870d9c7f4a 2023-02-07 16:57:49,414 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/0b995a767b724daa834346338e1762ae 2023-02-07 16:57:49,816 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/8588316f0c4e4103a4e3814b699538d9 2023-02-07 16:57:49,819 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/d6ba2869a81e4e71a74a20443a6e7fd9 2023-02-07 16:57:49,832 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302071c41fdcc659e424cbca0d48fb4c35ccd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302071c41fdcc659e424cbca0d48fb4c35ccd 2023-02-07 16:57:50,237 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/7d9de37fc5594f2eb9881c0a59590423 2023-02-07 16:57:50,239 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302076208f39b122f4cb39fae52c2d0a0554d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302076208f39b122f4cb39fae52c2d0a0554d 2023-02-07 16:57:50,240 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207357599686e884bf5828c7849f5db4de4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230207357599686e884bf5828c7849f5db4de4 2023-02-07 16:57:50,243 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/0b995a767b724daa834346338e1762ae as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/0b995a767b724daa834346338e1762ae 2023-02-07 16:57:50,246 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/ae0c229e3df2422d831640cc5ff03640 2023-02-07 16:57:50,247 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/0b995a767b724daa834346338e1762ae, entries=4, sequenceid=5, filesize=5.4 K 2023-02-07 16:57:50,248 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/7d9de37fc5594f2eb9881c0a59590423 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/7d9de37fc5594f2eb9881c0a59590423 2023-02-07 16:57:50,249 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/d6ba2869a81e4e71a74a20443a6e7fd9 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/d6ba2869a81e4e71a74a20443a6e7fd9 2023-02-07 16:57:50,252 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/7d9de37fc5594f2eb9881c0a59590423, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:57:50,252 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/d6ba2869a81e4e71a74a20443a6e7fd9, entries=4, sequenceid=5, filesize=5.4 K 2023-02-07 16:57:50,253 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d7073c73c9022e4ca4b7f790b115fb26 in 1261ms, sequenceid=5, compaction requested=false 2023-02-07 16:57:50,253 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-07 16:57:50,253 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d7073c73c9022e4ca4b7f790b115fb26: 2023-02-07 16:57:50,254 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:50,254 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:50,260 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/ae0c229e3df2422d831640cc5ff03640 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/ae0c229e3df2422d831640cc5ff03640 2023-02-07 16:57:50,264 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/ae0c229e3df2422d831640cc5ff03640, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:57:50,265 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 4744f35850a224eccfa1a64842abbd85 in 1274ms, sequenceid=5, compaction requested=false 2023-02-07 16:57:50,266 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4744f35850a224eccfa1a64842abbd85: 2023-02-07 16:57:50,266 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:50,266 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:50,646 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/5bccf7e2a02441448ca17e514ebcdcd0 2023-02-07 16:57:50,650 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/8588316f0c4e4103a4e3814b699538d9 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8588316f0c4e4103a4e3814b699538d9 2023-02-07 16:57:50,653 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8588316f0c4e4103a4e3814b699538d9, entries=4, sequenceid=5, filesize=5.4 K 2023-02-07 16:57:50,654 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/5bccf7e2a02441448ca17e514ebcdcd0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/5bccf7e2a02441448ca17e514ebcdcd0 2023-02-07 16:57:50,658 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/5bccf7e2a02441448ca17e514ebcdcd0, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:57:50,659 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for d4808dee17e59026f0dbc8ffe25e685f in 1667ms, sequenceid=5, compaction requested=false 2023-02-07 16:57:50,659 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d4808dee17e59026f0dbc8ffe25e685f: 2023-02-07 16:57:50,659 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:50,659 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:50,659 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:50,659 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,659 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-07 16:57:50,659 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-07 16:57:50,734 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:50,734 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:50,734 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:50,734 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:50,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:50,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:50,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:50,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:50,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-07 16:57:50,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31ac528e[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:50,735 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-07 16:57:50,735 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:50,744 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:50,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:50,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:50,744 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-07 16:57:50,744 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-07 16:57:50,744 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,744 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:50,744 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:50,755 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-07 16:57:50,755 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:50,755 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-07 16:57:50,755 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:50,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:50,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:50,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-07 16:57:50,757 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-07 16:57:50,757 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:50,757 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:50,757 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-07 16:57:50,757 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:50,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:50,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:50,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:50,766 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:50,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:50,767 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:50,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:50,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:50,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,776 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:50,776 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:50,776 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:50,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:50,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-07 16:57:50,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:50,776 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:50,776 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:50,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-07 16:57:50,776 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:50,776 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:50,776 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:50,776 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:50,777 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:50,777 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:50,777 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:50,777 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,877 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:50,877 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:50,877 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:50,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:50,880 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:50,880 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:50,880 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:50,884 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:50,884 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:50,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:50,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:50,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-07 16:57:50,886 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-07 16:57:50,886 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:50,886 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-07 16:57:50,886 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-07 16:57:50,887 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,887 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:50,891 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,892 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:50,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:50,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:50,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:50,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:50,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:50,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:50,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:50,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:50,893 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-07 16:57:50,893 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-07 16:57:50,893 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-07 16:57:50,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-07 16:57:50,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:50,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-07 16:57:50,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:50,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. started... 2023-02-07 16:57:50,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:50,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:50,893 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4744f35850a224eccfa1a64842abbd85 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:57:50,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:50,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. started... 2023-02-07 16:57:50,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:50,894 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. started... 2023-02-07 16:57:50,894 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d4808dee17e59026f0dbc8ffe25e685f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:57:50,894 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d7073c73c9022e4ca4b7f790b115fb26 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:57:51,316 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020725604b02de444b848e4585ace0691db8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023020725604b02de444b848e4585ace0691db8 2023-02-07 16:57:51,316 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207e9138fc26a764c09872612a7b6cecd8f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230207e9138fc26a764c09872612a7b6cecd8f 2023-02-07 16:57:51,316 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207afb30654f932430b903eafbea9e75f9c to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230207afb30654f932430b903eafbea9e75f9c 2023-02-07 16:57:51,723 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/3dc58d0f1c0e45379e49ca1e92afa60e 2023-02-07 16:57:51,723 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/41930aa1ee13482b8346425093b63a26 2023-02-07 16:57:51,723 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/92ecfff709d74f10a9508844bdcf9666 2023-02-07 16:57:52,146 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207c347b265c3b74185ab25eb8297fa40fc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230207c347b265c3b74185ab25eb8297fa40fc 2023-02-07 16:57:52,146 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207400aeab945104836a5faf63700fc5b9a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230207400aeab945104836a5faf63700fc5b9a 2023-02-07 16:57:52,146 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020744c7d5408b6e4a14940ff9e34efd8a44 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023020744c7d5408b6e4a14940ff9e34efd8a44 2023-02-07 16:57:52,633 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/40ec771eb75f4ff8959583c5a0db39e0 2023-02-07 16:57:52,633 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/b54e5da25bf5468f8ac70f09d385fe11 2023-02-07 16:57:52,633 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/f20ec70928cc4db5873854609f35e683 2023-02-07 16:57:52,643 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/3dc58d0f1c0e45379e49ca1e92afa60e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/3dc58d0f1c0e45379e49ca1e92afa60e 2023-02-07 16:57:52,643 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/92ecfff709d74f10a9508844bdcf9666 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/92ecfff709d74f10a9508844bdcf9666 2023-02-07 16:57:52,643 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/41930aa1ee13482b8346425093b63a26 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/41930aa1ee13482b8346425093b63a26 2023-02-07 16:57:52,647 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/92ecfff709d74f10a9508844bdcf9666, entries=4, sequenceid=9, filesize=5.4 K 2023-02-07 16:57:52,647 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/3dc58d0f1c0e45379e49ca1e92afa60e, entries=4, sequenceid=9, filesize=5.4 K 2023-02-07 16:57:52,648 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/b54e5da25bf5468f8ac70f09d385fe11 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/b54e5da25bf5468f8ac70f09d385fe11 2023-02-07 16:57:52,649 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/41930aa1ee13482b8346425093b63a26, entries=4, sequenceid=9, filesize=5.4 K 2023-02-07 16:57:52,649 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/f20ec70928cc4db5873854609f35e683 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/f20ec70928cc4db5873854609f35e683 2023-02-07 16:57:52,650 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/40ec771eb75f4ff8959583c5a0db39e0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/40ec771eb75f4ff8959583c5a0db39e0 2023-02-07 16:57:52,653 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/b54e5da25bf5468f8ac70f09d385fe11, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:57:52,653 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 4744f35850a224eccfa1a64842abbd85 in 1760ms, sequenceid=9, compaction requested=false 2023-02-07 16:57:52,654 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4744f35850a224eccfa1a64842abbd85: 2023-02-07 16:57:52,654 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:52,654 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:52,654 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/f20ec70928cc4db5873854609f35e683, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:57:52,655 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d4808dee17e59026f0dbc8ffe25e685f in 1761ms, sequenceid=9, compaction requested=false 2023-02-07 16:57:52,655 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/40ec771eb75f4ff8959583c5a0db39e0, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:57:52,655 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d4808dee17e59026f0dbc8ffe25e685f: 2023-02-07 16:57:52,655 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:52,655 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:52,656 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for d7073c73c9022e4ca4b7f790b115fb26 in 1762ms, sequenceid=9, compaction requested=false 2023-02-07 16:57:52,656 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d7073c73c9022e4ca4b7f790b115fb26: 2023-02-07 16:57:52,656 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:52,656 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:52,656 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:52,656 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,656 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-07 16:57:52,656 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-07 16:57:52,707 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,707 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:52,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:52,708 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:52,708 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:52,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:52,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-07 16:57:52,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@86cfeee[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:52,709 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-07 16:57:52,710 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:52,723 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:52,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:52,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:52,723 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-07 16:57:52,723 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-07 16:57:52,723 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:52,723 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,723 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:52,734 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-07 16:57:52,734 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:52,734 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-07 16:57:52,734 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:52,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:52,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:52,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:52,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:52,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:52,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:52,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-07 16:57:52,740 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-07 16:57:52,740 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:52,740 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:52,740 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-07 16:57:52,740 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:52,753 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,753 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,753 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:52,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:52,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:52,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:52,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:52,755 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:52,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:52,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:52,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:52,758 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:52,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:52,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:52,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:52,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-07 16:57:52,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:52,765 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:52,765 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:52,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:52,766 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:52,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-07 16:57:52,766 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:52,766 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:52,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:52,766 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,767 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:52,767 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:52,767 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:52,867 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:52,867 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:52,867 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:52,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:52,871 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:52,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:52,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:52,877 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:52,878 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:52,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:52,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:52,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-07 16:57:52,882 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-07 16:57:52,882 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:52,882 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-07 16:57:52,882 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-07 16:57:52,882 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,882 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:52,891 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:52,891 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:52,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:52,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:52,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:52,892 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:52,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:52,892 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-07 16:57:52,893 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-07 16:57:52,893 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-07 16:57:52,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-07 16:57:52,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:52,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-07 16:57:52,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:52,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. started... 2023-02-07 16:57:52,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:52,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. started... 2023-02-07 16:57:52,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:52,893 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:52,893 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4744f35850a224eccfa1a64842abbd85 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:57:52,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:52,893 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d4808dee17e59026f0dbc8ffe25e685f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:57:52,893 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. started... 2023-02-07 16:57:52,894 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d7073c73c9022e4ca4b7f790b115fb26 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:57:53,323 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207cbdafa2443e24bc785cdfa863d44809b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230207cbdafa2443e24bc785cdfa863d44809b 2023-02-07 16:57:53,323 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207083120fa867a4ead9ccd873fe2329ee1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230207083120fa867a4ead9ccd873fe2329ee1 2023-02-07 16:57:53,323 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207985684b2b2c04add93c47e447d27a0fc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230207985684b2b2c04add93c47e447d27a0fc 2023-02-07 16:57:53,510 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:57:53,729 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/8f88b2e8155544f2ad13e171a1ae0768 2023-02-07 16:57:53,729 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/d1b0cc8b99464a08bb11f44135bfae91 2023-02-07 16:57:53,730 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/58a5c115f869421ebd6ca6ba8f1a9dfb 2023-02-07 16:57:53,748 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207307f6fffd8a04055952838df6b6908a2 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230207307f6fffd8a04055952838df6b6908a2 2023-02-07 16:57:53,748 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302070dd43ee9d43042ba92fad3bcb956e3b9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302070dd43ee9d43042ba92fad3bcb956e3b9 2023-02-07 16:57:54,151 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207ebc4c7769fd34e50a59933ba6fff0419 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230207ebc4c7769fd34e50a59933ba6fff0419 2023-02-07 16:57:54,153 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/620d011975f044d48b06baf6c536fe1e 2023-02-07 16:57:54,153 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/7992580a53fd4e9e8fdd618e3e55144f 2023-02-07 16:57:54,159 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/58a5c115f869421ebd6ca6ba8f1a9dfb as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/58a5c115f869421ebd6ca6ba8f1a9dfb 2023-02-07 16:57:54,159 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/8f88b2e8155544f2ad13e171a1ae0768 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8f88b2e8155544f2ad13e171a1ae0768 2023-02-07 16:57:54,163 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/58a5c115f869421ebd6ca6ba8f1a9dfb, entries=4, sequenceid=13, filesize=5.4 K 2023-02-07 16:57:54,163 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8f88b2e8155544f2ad13e171a1ae0768, entries=4, sequenceid=13, filesize=5.4 K 2023-02-07 16:57:54,163 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/620d011975f044d48b06baf6c536fe1e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/620d011975f044d48b06baf6c536fe1e 2023-02-07 16:57:54,164 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/7992580a53fd4e9e8fdd618e3e55144f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/7992580a53fd4e9e8fdd618e3e55144f 2023-02-07 16:57:54,167 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/620d011975f044d48b06baf6c536fe1e, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:57:54,168 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/7992580a53fd4e9e8fdd618e3e55144f, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:57:54,168 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 4744f35850a224eccfa1a64842abbd85 in 1275ms, sequenceid=13, compaction requested=true 2023-02-07 16:57:54,168 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4744f35850a224eccfa1a64842abbd85: 2023-02-07 16:57:54,168 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:54,168 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d4808dee17e59026f0dbc8ffe25e685f in 1275ms, sequenceid=13, compaction requested=true 2023-02-07 16:57:54,168 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:54,168 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d4808dee17e59026f0dbc8ffe25e685f: 2023-02-07 16:57:54,168 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:54,168 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:54,558 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/78956611b6cf41e08a7b3c9a09f86bdc 2023-02-07 16:57:54,566 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/d1b0cc8b99464a08bb11f44135bfae91 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/d1b0cc8b99464a08bb11f44135bfae91 2023-02-07 16:57:54,574 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/d1b0cc8b99464a08bb11f44135bfae91, entries=4, sequenceid=13, filesize=5.4 K 2023-02-07 16:57:54,576 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/78956611b6cf41e08a7b3c9a09f86bdc as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/78956611b6cf41e08a7b3c9a09f86bdc 2023-02-07 16:57:54,584 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/78956611b6cf41e08a7b3c9a09f86bdc, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:57:54,585 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for d7073c73c9022e4ca4b7f790b115fb26 in 1691ms, sequenceid=13, compaction requested=true 2023-02-07 16:57:54,585 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d7073c73c9022e4ca4b7f790b115fb26: 2023-02-07 16:57:54,585 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:54,585 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:54,585 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:54,585 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,585 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-07 16:57:54,585 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-07 16:57:54,628 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:54,628 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:54,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:54,629 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:54,629 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:54,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:54,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:54,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:54,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:54,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-07 16:57:54,635 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b54043b[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:54,636 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-07 16:57:54,636 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:54,648 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:54,648 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:54,649 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-07 16:57:54,649 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-07 16:57:54,649 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:54,649 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,649 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:54,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-07 16:57:54,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:54,660 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-07 16:57:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:54,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:54,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-07 16:57:54,670 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-07 16:57:54,670 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:54,670 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:54,670 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-07 16:57:54,670 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:54,681 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,681 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:54,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,681 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:54,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:54,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:54,682 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:54,683 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:54,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,691 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:54,691 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-07 16:57:54,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:54,691 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:54,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:54,691 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:54,691 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:54,692 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:54,692 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:54,692 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:54,692 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,692 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:54,692 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:54,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:54,692 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:54,792 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:54,792 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:54,792 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:54,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:54,795 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:54,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:54,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:57:54,800 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:54,800 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:54,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:54,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:54,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-07 16:57:54,806 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-07 16:57:54,806 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:54,806 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-07 16:57:54,806 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-07 16:57:54,807 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,807 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:54,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:54,818 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:54,818 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:54,818 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:54,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:54,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:54,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:54,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:54,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-07 16:57:54,820 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-07 16:57:54,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-07 16:57:54,820 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-07 16:57:54,820 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:54,820 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-07 16:57:54,820 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:54,820 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. started... 2023-02-07 16:57:54,820 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:54,820 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:54,820 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:54,820 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4744f35850a224eccfa1a64842abbd85 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:57:54,820 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:54,821 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. started... 2023-02-07 16:57:54,820 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. started... 2023-02-07 16:57:54,821 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d7073c73c9022e4ca4b7f790b115fb26 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:57:54,821 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d4808dee17e59026f0dbc8ffe25e685f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:57:55,243 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020795560569d4f14483b8fc431a09bf6633 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020795560569d4f14483b8fc431a09bf6633 2023-02-07 16:57:55,243 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207d40b3bee8d624acfb2161e1c7fd32b1f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230207d40b3bee8d624acfb2161e1c7fd32b1f 2023-02-07 16:57:55,243 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302077d305919dfb4478c9c80f14e93ae3c90 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302077d305919dfb4478c9c80f14e93ae3c90 2023-02-07 16:57:55,248 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/234dd4e87a224712bb0c9658a189775e 2023-02-07 16:57:55,648 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/73066448c1c84dc9aa72c73c48ebae0d 2023-02-07 16:57:55,648 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/3ba3496104e840c78601767a001f46b9 2023-02-07 16:57:55,663 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302079ba5529e71f24c8996354c1c8628b34d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302079ba5529e71f24c8996354c1c8628b34d 2023-02-07 16:57:55,664 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302079be62d0260b44cb9a6106f16ba48c932 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302079be62d0260b44cb9a6106f16ba48c932 2023-02-07 16:57:56,068 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/5866820e86014f9abeffff863ec60bfd 2023-02-07 16:57:56,070 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/6828570627e94ed3abd38c67420763f4 2023-02-07 16:57:56,073 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207eabf55d254964d93b74893c3531ca5dd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230207eabf55d254964d93b74893c3531ca5dd 2023-02-07 16:57:56,076 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/234dd4e87a224712bb0c9658a189775e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/234dd4e87a224712bb0c9658a189775e 2023-02-07 16:57:56,077 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/73066448c1c84dc9aa72c73c48ebae0d as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/73066448c1c84dc9aa72c73c48ebae0d 2023-02-07 16:57:56,079 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/3aed96f0aaf641e599aa5cb03aa9ee07 2023-02-07 16:57:56,081 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/234dd4e87a224712bb0c9658a189775e, entries=4, sequenceid=17, filesize=5.4 K 2023-02-07 16:57:56,082 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/73066448c1c84dc9aa72c73c48ebae0d, entries=4, sequenceid=17, filesize=5.4 K 2023-02-07 16:57:56,085 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/6828570627e94ed3abd38c67420763f4 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6828570627e94ed3abd38c67420763f4 2023-02-07 16:57:56,085 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/5866820e86014f9abeffff863ec60bfd as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/5866820e86014f9abeffff863ec60bfd 2023-02-07 16:57:56,087 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/3ba3496104e840c78601767a001f46b9 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/3ba3496104e840c78601767a001f46b9 2023-02-07 16:57:56,089 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6828570627e94ed3abd38c67420763f4, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:57:56,090 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 4744f35850a224eccfa1a64842abbd85 in 1269ms, sequenceid=17, compaction requested=true 2023-02-07 16:57:56,090 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4744f35850a224eccfa1a64842abbd85: 2023-02-07 16:57:56,090 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:56,090 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/5866820e86014f9abeffff863ec60bfd, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:57:56,090 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:56,090 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/3ba3496104e840c78601767a001f46b9, entries=4, sequenceid=17, filesize=5.4 K 2023-02-07 16:57:56,090 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d7073c73c9022e4ca4b7f790b115fb26 in 1269ms, sequenceid=17, compaction requested=true 2023-02-07 16:57:56,090 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d7073c73c9022e4ca4b7f790b115fb26: 2023-02-07 16:57:56,090 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:56,090 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:56,091 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/3aed96f0aaf641e599aa5cb03aa9ee07 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/3aed96f0aaf641e599aa5cb03aa9ee07 2023-02-07 16:57:56,094 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/3aed96f0aaf641e599aa5cb03aa9ee07, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:57:56,094 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for d4808dee17e59026f0dbc8ffe25e685f in 1273ms, sequenceid=17, compaction requested=true 2023-02-07 16:57:56,094 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d4808dee17e59026f0dbc8ffe25e685f: 2023-02-07 16:57:56,094 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:56,094 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:56,094 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:56,094 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,095 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-07 16:57:56,095 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-07 16:57:56,165 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:56,165 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:56,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:56,166 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:56,166 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:56,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:56,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:56,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:56,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-07 16:57:56,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c2f0311[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:56,170 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-07 16:57:56,170 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:56,175 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:56,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:56,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:56,176 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-07 16:57:56,176 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-07 16:57:56,176 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:56,176 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,176 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:56,186 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-07 16:57:56,186 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:56,186 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,186 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-07 16:57:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:56,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:56,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:56,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:56,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:56,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:56,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:56,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-07 16:57:56,195 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-07 16:57:56,195 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:56,195 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:56,195 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-07 16:57:56,195 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:56,207 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,207 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:56,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:56,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,207 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:56,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:56,208 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:56,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:56,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:56,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:56,212 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:56,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:56,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,227 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,227 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:56,227 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:56,227 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:56,227 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,227 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:56,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-07 16:57:56,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:56,227 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:56,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-07 16:57:56,227 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:56,228 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:56,228 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:56,227 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:56,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:56,227 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:56,228 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:56,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:56,328 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:56,329 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:56,329 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:56,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:56,349 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:56,354 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:56,361 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:57:56,362 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:57:56,390 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:56,390 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:56,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:57:56,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-07 16:57:56,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-07 16:57:56,393 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-07 16:57:56,393 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:56,393 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-07 16:57:56,393 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-07 16:57:56,393 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,393 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:56,405 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:56,406 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:56,406 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:56,406 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:57:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:56,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:57:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:56,407 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-07 16:57:56,407 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-07 16:57:56,407 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-07 16:57:56,407 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-07 16:57:56,407 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:57:56,407 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-07 16:57:56,407 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:56,407 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. started... 2023-02-07 16:57:56,407 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:56,408 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. started... 2023-02-07 16:57:56,408 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:56,408 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing d4808dee17e59026f0dbc8ffe25e685f 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:57:56,408 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:57:56,408 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:57:56,408 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. started... 2023-02-07 16:57:56,408 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 4744f35850a224eccfa1a64842abbd85 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:57:56,408 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing d7073c73c9022e4ca4b7f790b115fb26 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:57:56,823 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/6e9b2b54e21d40ca8a62ef240fe74f08 2023-02-07 16:57:56,826 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/c12b554e4db44bcaa0f418731904a23d 2023-02-07 16:57:56,827 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/cf173144c1ec4ca5ada22089e263c73f 2023-02-07 16:57:56,828 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e9b2b54e21d40ca8a62ef240fe74f08 2023-02-07 16:57:56,831 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c12b554e4db44bcaa0f418731904a23d 2023-02-07 16:57:56,831 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf173144c1ec4ca5ada22089e263c73f 2023-02-07 16:57:57,646 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/2bd00b89baa74e5ea489c052b5277b75 2023-02-07 16:57:57,646 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/6f21edcc4cc04013983d7ff3d48925cc 2023-02-07 16:57:57,648 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/adcfde16919d4bf8b3bb5a07f55b8eb1 2023-02-07 16:57:57,650 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f21edcc4cc04013983d7ff3d48925cc 2023-02-07 16:57:57,650 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bd00b89baa74e5ea489c052b5277b75 2023-02-07 16:57:57,650 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/6e9b2b54e21d40ca8a62ef240fe74f08 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/6e9b2b54e21d40ca8a62ef240fe74f08 2023-02-07 16:57:57,650 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/cf173144c1ec4ca5ada22089e263c73f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/cf173144c1ec4ca5ada22089e263c73f 2023-02-07 16:57:57,651 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adcfde16919d4bf8b3bb5a07f55b8eb1 2023-02-07 16:57:57,652 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/c12b554e4db44bcaa0f418731904a23d as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/c12b554e4db44bcaa0f418731904a23d 2023-02-07 16:57:57,653 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6e9b2b54e21d40ca8a62ef240fe74f08 2023-02-07 16:57:57,653 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf173144c1ec4ca5ada22089e263c73f 2023-02-07 16:57:57,653 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/6e9b2b54e21d40ca8a62ef240fe74f08, entries=3, sequenceid=23, filesize=5.0 K 2023-02-07 16:57:57,653 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/cf173144c1ec4ca5ada22089e263c73f, entries=3, sequenceid=23, filesize=5.0 K 2023-02-07 16:57:57,654 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/6f21edcc4cc04013983d7ff3d48925cc as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6f21edcc4cc04013983d7ff3d48925cc 2023-02-07 16:57:57,654 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/2bd00b89baa74e5ea489c052b5277b75 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/2bd00b89baa74e5ea489c052b5277b75 2023-02-07 16:57:57,655 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c12b554e4db44bcaa0f418731904a23d 2023-02-07 16:57:57,656 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/c12b554e4db44bcaa0f418731904a23d, entries=3, sequenceid=23, filesize=5.0 K 2023-02-07 16:57:57,656 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/adcfde16919d4bf8b3bb5a07f55b8eb1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/adcfde16919d4bf8b3bb5a07f55b8eb1 2023-02-07 16:57:57,657 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6f21edcc4cc04013983d7ff3d48925cc 2023-02-07 16:57:57,658 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6f21edcc4cc04013983d7ff3d48925cc, entries=1, sequenceid=23, filesize=5.0 K 2023-02-07 16:57:57,658 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2bd00b89baa74e5ea489c052b5277b75 2023-02-07 16:57:57,658 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/2bd00b89baa74e5ea489c052b5277b75, entries=1, sequenceid=23, filesize=5.0 K 2023-02-07 16:57:57,659 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for adcfde16919d4bf8b3bb5a07f55b8eb1 2023-02-07 16:57:57,660 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/adcfde16919d4bf8b3bb5a07f55b8eb1, entries=1, sequenceid=23, filesize=5.0 K 2023-02-07 16:57:57,660 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 4744f35850a224eccfa1a64842abbd85 in 1252ms, sequenceid=23, compaction requested=true 2023-02-07 16:57:57,660 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d7073c73c9022e4ca4b7f790b115fb26 in 1252ms, sequenceid=23, compaction requested=true 2023-02-07 16:57:57,660 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 4744f35850a224eccfa1a64842abbd85: 2023-02-07 16:57:57,660 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for d7073c73c9022e4ca4b7f790b115fb26: 2023-02-07 16:57:57,660 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:57:57,660 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:57,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:57:57,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:57:57,660 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for d4808dee17e59026f0dbc8ffe25e685f in 1252ms, sequenceid=23, compaction requested=true 2023-02-07 16:57:57,660 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for d4808dee17e59026f0dbc8ffe25e685f: 2023-02-07 16:57:57,660 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:57:57,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:57:57,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:57:57,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-07 16:57:57,660 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-07 16:57:57,775 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,775 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:57,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:57,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:57,776 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:57,776 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:57:57,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:57,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:57,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:57,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-07 16:57:57,779 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f441c38[Count = 0] remaining members to acquire global barrier 2023-02-07 16:57:57,779 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-07 16:57:57,779 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:57,846 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:57,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:57,846 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-07 16:57:57,846 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-07 16:57:57,846 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,846 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:57:57,846 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:57:57,859 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-07 16:57:57,860 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:57,860 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-07 16:57:57,859 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:57,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:57:57,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-07 16:57:57,862 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-07 16:57:57,862 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:57:57,862 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:57:57,862 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-07 16:57:57,862 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:57:57,870 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:57,870 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:57,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:57,870 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:57:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:57:57,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:57,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:57,870 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:57:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:57,871 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:57:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-07 16:57:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:57,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:57:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:57:57,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-07 16:57:57,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:57:57,890 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-07 16:57:57,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-07 16:57:57,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:57:57,890 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:57:57,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:57:57,991 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:57:57,991 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:57:57,991 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:57:57,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:57:57,992 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:57,992 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 4744f35850a224eccfa1a64842abbd85/family1 is initiating major compaction (all files) 2023-02-07 16:57:57,992 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:57:57,992 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:57:57,992 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 4744f35850a224eccfa1a64842abbd85/family1 in ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:57,992 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/d6ba2869a81e4e71a74a20443a6e7fd9, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/3dc58d0f1c0e45379e49ca1e92afa60e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/58a5c115f869421ebd6ca6ba8f1a9dfb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/73066448c1c84dc9aa72c73c48ebae0d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/6e9b2b54e21d40ca8a62ef240fe74f08] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp, totalSize=26.6 K 2023-02-07 16:57:57,993 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting d6ba2869a81e4e71a74a20443a6e7fd9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789068960 2023-02-07 16:57:57,993 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 3dc58d0f1c0e45379e49ca1e92afa60e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789070880 2023-02-07 16:57:57,994 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 58a5c115f869421ebd6ca6ba8f1a9dfb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789072872 2023-02-07 16:57:57,994 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 73066448c1c84dc9aa72c73c48ebae0d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789074796 2023-02-07 16:57:57,994 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 6e9b2b54e21d40ca8a62ef240fe74f08, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:57:58,003 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 4744f35850a224eccfa1a64842abbd85#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:58,411 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230207f67bb6845c14436aafc27a7b40ec7ad4_del 2023-02-07 16:57:58,411 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207f67bb6845c14436aafc27a7b40ec7ad4_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230207f67bb6845c14436aafc27a7b40ec7ad4_del 2023-02-07 16:57:59,224 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0f0427e394e4b6aafda36411b2f0bff 2023-02-07 16:57:59,225 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family1/a0f0427e394e4b6aafda36411b2f0bff as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/a0f0427e394e4b6aafda36411b2f0bff 2023-02-07 16:57:59,228 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a0f0427e394e4b6aafda36411b2f0bff 2023-02-07 16:57:59,228 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4744f35850a224eccfa1a64842abbd85/family1 of 4744f35850a224eccfa1a64842abbd85 into a0f0427e394e4b6aafda36411b2f0bff(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:57:59,229 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 4744f35850a224eccfa1a64842abbd85: 2023-02-07 16:57:59,229 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:57:59,229 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 4744f35850a224eccfa1a64842abbd85/family2 is initiating major compaction (all files) 2023-02-07 16:57:59,229 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:57:59,229 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:57:59,230 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 4744f35850a224eccfa1a64842abbd85/family2 in ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:57:59,230 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/ae0c229e3df2422d831640cc5ff03640, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/b54e5da25bf5468f8ac70f09d385fe11, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/620d011975f044d48b06baf6c536fe1e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6828570627e94ed3abd38c67420763f4, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6f21edcc4cc04013983d7ff3d48925cc] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp, totalSize=25.3 K 2023-02-07 16:57:59,230 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting ae0c229e3df2422d831640cc5ff03640, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789068960 2023-02-07 16:57:59,231 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting b54e5da25bf5468f8ac70f09d385fe11, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789070880 2023-02-07 16:57:59,231 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 620d011975f044d48b06baf6c536fe1e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789072872 2023-02-07 16:57:59,231 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 6828570627e94ed3abd38c67420763f4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789074796 2023-02-07 16:57:59,231 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 6f21edcc4cc04013983d7ff3d48925cc, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:57:59,238 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 4744f35850a224eccfa1a64842abbd85#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:57:59,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/d6ba2869a81e4e71a74a20443a6e7fd9, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/3dc58d0f1c0e45379e49ca1e92afa60e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/58a5c115f869421ebd6ca6ba8f1a9dfb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/73066448c1c84dc9aa72c73c48ebae0d, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/6e9b2b54e21d40ca8a62ef240fe74f08] to archive 2023-02-07 16:57:59,254 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:57:59,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/d6ba2869a81e4e71a74a20443a6e7fd9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/d6ba2869a81e4e71a74a20443a6e7fd9 2023-02-07 16:57:59,256 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/3dc58d0f1c0e45379e49ca1e92afa60e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/3dc58d0f1c0e45379e49ca1e92afa60e 2023-02-07 16:57:59,257 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/58a5c115f869421ebd6ca6ba8f1a9dfb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/58a5c115f869421ebd6ca6ba8f1a9dfb 2023-02-07 16:57:59,258 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/73066448c1c84dc9aa72c73c48ebae0d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/73066448c1c84dc9aa72c73c48ebae0d 2023-02-07 16:57:59,259 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/6e9b2b54e21d40ca8a62ef240fe74f08 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/6e9b2b54e21d40ca8a62ef240fe74f08 2023-02-07 16:57:59,644 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230207d85921ec8b0e496f815fee0e3fbeb1c9_del 2023-02-07 16:57:59,645 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207d85921ec8b0e496f815fee0e3fbeb1c9_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230207d85921ec8b0e496f815fee0e3fbeb1c9_del 2023-02-07 16:58:00,463 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9412a7b690442b0a13afb3455a89dc0 2023-02-07 16:58:00,465 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/.tmp/family2/a9412a7b690442b0a13afb3455a89dc0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/a9412a7b690442b0a13afb3455a89dc0 2023-02-07 16:58:00,472 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a9412a7b690442b0a13afb3455a89dc0 2023-02-07 16:58:00,473 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 4744f35850a224eccfa1a64842abbd85/family2 of 4744f35850a224eccfa1a64842abbd85 into a9412a7b690442b0a13afb3455a89dc0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:58:00,474 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 4744f35850a224eccfa1a64842abbd85: 2023-02-07 16:58:00,474 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:00,474 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): d4808dee17e59026f0dbc8ffe25e685f/family1 is initiating major compaction (all files) 2023-02-07 16:58:00,474 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:00,474 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:00,474 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of d4808dee17e59026f0dbc8ffe25e685f/family1 in ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:58:00,475 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8588316f0c4e4103a4e3814b699538d9, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/92ecfff709d74f10a9508844bdcf9666, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8f88b2e8155544f2ad13e171a1ae0768, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/3ba3496104e840c78601767a001f46b9, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/c12b554e4db44bcaa0f418731904a23d] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp, totalSize=26.6 K 2023-02-07 16:58:00,475 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 8588316f0c4e4103a4e3814b699538d9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789068960 2023-02-07 16:58:00,476 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 92ecfff709d74f10a9508844bdcf9666, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789070880 2023-02-07 16:58:00,476 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 8f88b2e8155544f2ad13e171a1ae0768, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789072872 2023-02-07 16:58:00,476 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 3ba3496104e840c78601767a001f46b9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789074796 2023-02-07 16:58:00,477 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting c12b554e4db44bcaa0f418731904a23d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:00,488 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): d4808dee17e59026f0dbc8ffe25e685f#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:00,552 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/ae0c229e3df2422d831640cc5ff03640, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/b54e5da25bf5468f8ac70f09d385fe11, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/620d011975f044d48b06baf6c536fe1e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6828570627e94ed3abd38c67420763f4, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6f21edcc4cc04013983d7ff3d48925cc] to archive 2023-02-07 16:58:00,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:00,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/ae0c229e3df2422d831640cc5ff03640 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/ae0c229e3df2422d831640cc5ff03640 2023-02-07 16:58:00,555 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/b54e5da25bf5468f8ac70f09d385fe11 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/b54e5da25bf5468f8ac70f09d385fe11 2023-02-07 16:58:00,556 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/620d011975f044d48b06baf6c536fe1e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/620d011975f044d48b06baf6c536fe1e 2023-02-07 16:58:00,557 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6828570627e94ed3abd38c67420763f4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6828570627e94ed3abd38c67420763f4 2023-02-07 16:58:00,558 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6f21edcc4cc04013983d7ff3d48925cc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family2/6f21edcc4cc04013983d7ff3d48925cc 2023-02-07 16:58:00,904 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302073c68895df1d8422fa659af467e0d654f_del 2023-02-07 16:58:00,904 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302073c68895df1d8422fa659af467e0d654f_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302073c68895df1d8422fa659af467e0d654f_del 2023-02-07 16:58:01,323 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf42de36745345899956e94c6f857a89 2023-02-07 16:58:01,324 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family1/cf42de36745345899956e94c6f857a89 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/cf42de36745345899956e94c6f857a89 2023-02-07 16:58:01,329 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf42de36745345899956e94c6f857a89 2023-02-07 16:58:01,330 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d4808dee17e59026f0dbc8ffe25e685f/family1 of d4808dee17e59026f0dbc8ffe25e685f into cf42de36745345899956e94c6f857a89(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:58:01,330 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for d4808dee17e59026f0dbc8ffe25e685f: 2023-02-07 16:58:01,330 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:01,330 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): d4808dee17e59026f0dbc8ffe25e685f/family2 is initiating major compaction (all files) 2023-02-07 16:58:01,330 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:01,330 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:01,330 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of d4808dee17e59026f0dbc8ffe25e685f/family2 in ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:58:01,331 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/5bccf7e2a02441448ca17e514ebcdcd0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/f20ec70928cc4db5873854609f35e683, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/7992580a53fd4e9e8fdd618e3e55144f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/3aed96f0aaf641e599aa5cb03aa9ee07, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/adcfde16919d4bf8b3bb5a07f55b8eb1] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp, totalSize=25.3 K 2023-02-07 16:58:01,331 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 5bccf7e2a02441448ca17e514ebcdcd0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789068960 2023-02-07 16:58:01,331 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting f20ec70928cc4db5873854609f35e683, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789070880 2023-02-07 16:58:01,332 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 7992580a53fd4e9e8fdd618e3e55144f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789072872 2023-02-07 16:58:01,332 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 3aed96f0aaf641e599aa5cb03aa9ee07, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789074796 2023-02-07 16:58:01,332 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting adcfde16919d4bf8b3bb5a07f55b8eb1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:01,341 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): d4808dee17e59026f0dbc8ffe25e685f#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:01,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8588316f0c4e4103a4e3814b699538d9, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/92ecfff709d74f10a9508844bdcf9666, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8f88b2e8155544f2ad13e171a1ae0768, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/3ba3496104e840c78601767a001f46b9, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/c12b554e4db44bcaa0f418731904a23d] to archive 2023-02-07 16:58:01,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:01,354 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8588316f0c4e4103a4e3814b699538d9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8588316f0c4e4103a4e3814b699538d9 2023-02-07 16:58:01,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/92ecfff709d74f10a9508844bdcf9666 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/92ecfff709d74f10a9508844bdcf9666 2023-02-07 16:58:01,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8f88b2e8155544f2ad13e171a1ae0768 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/8f88b2e8155544f2ad13e171a1ae0768 2023-02-07 16:58:01,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/3ba3496104e840c78601767a001f46b9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/3ba3496104e840c78601767a001f46b9 2023-02-07 16:58:01,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/c12b554e4db44bcaa0f418731904a23d to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/c12b554e4db44bcaa0f418731904a23d 2023-02-07 16:58:01,751 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302074eac775bfd7a453ca56287df9d7cdcfa_del 2023-02-07 16:58:01,751 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302074eac775bfd7a453ca56287df9d7cdcfa_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302074eac775bfd7a453ca56287df9d7cdcfa_del 2023-02-07 16:58:02,582 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f8ef5ce4bfa4e8abfc26605e112ec13 2023-02-07 16:58:02,583 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/.tmp/family2/7f8ef5ce4bfa4e8abfc26605e112ec13 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/7f8ef5ce4bfa4e8abfc26605e112ec13 2023-02-07 16:58:02,589 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f8ef5ce4bfa4e8abfc26605e112ec13 2023-02-07 16:58:02,590 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d4808dee17e59026f0dbc8ffe25e685f/family2 of d4808dee17e59026f0dbc8ffe25e685f into 7f8ef5ce4bfa4e8abfc26605e112ec13(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:58:02,590 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for d4808dee17e59026f0dbc8ffe25e685f: 2023-02-07 16:58:02,590 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:02,590 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): d7073c73c9022e4ca4b7f790b115fb26/family1 is initiating major compaction (all files) 2023-02-07 16:58:02,591 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:02,591 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:02,591 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of d7073c73c9022e4ca4b7f790b115fb26/family1 in ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:58:02,591 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/0b995a767b724daa834346338e1762ae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/41930aa1ee13482b8346425093b63a26, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/d1b0cc8b99464a08bb11f44135bfae91, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/234dd4e87a224712bb0c9658a189775e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/cf173144c1ec4ca5ada22089e263c73f] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp, totalSize=26.6 K 2023-02-07 16:58:02,592 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 0b995a767b724daa834346338e1762ae, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789068959 2023-02-07 16:58:02,592 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 41930aa1ee13482b8346425093b63a26, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789070879 2023-02-07 16:58:02,593 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting d1b0cc8b99464a08bb11f44135bfae91, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789072871 2023-02-07 16:58:02,593 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 234dd4e87a224712bb0c9658a189775e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789074795 2023-02-07 16:58:02,593 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting cf173144c1ec4ca5ada22089e263c73f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:02,604 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): d7073c73c9022e4ca4b7f790b115fb26#family1#compaction#154 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:02,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/5bccf7e2a02441448ca17e514ebcdcd0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/f20ec70928cc4db5873854609f35e683, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/7992580a53fd4e9e8fdd618e3e55144f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/3aed96f0aaf641e599aa5cb03aa9ee07, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/adcfde16919d4bf8b3bb5a07f55b8eb1] to archive 2023-02-07 16:58:02,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:02,660 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/5bccf7e2a02441448ca17e514ebcdcd0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/5bccf7e2a02441448ca17e514ebcdcd0 2023-02-07 16:58:02,662 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/f20ec70928cc4db5873854609f35e683 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/f20ec70928cc4db5873854609f35e683 2023-02-07 16:58:02,663 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/7992580a53fd4e9e8fdd618e3e55144f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/7992580a53fd4e9e8fdd618e3e55144f 2023-02-07 16:58:02,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/3aed96f0aaf641e599aa5cb03aa9ee07 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/3aed96f0aaf641e599aa5cb03aa9ee07 2023-02-07 16:58:02,666 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/adcfde16919d4bf8b3bb5a07f55b8eb1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family2/adcfde16919d4bf8b3bb5a07f55b8eb1 2023-02-07 16:58:02,943 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:58:02,943 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fb6674a to 127.0.0.1:56335 2023-02-07 16:58:02,943 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:02,943 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:58:02,943 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48144f16 to 127.0.0.1:56335 2023-02-07 16:58:02,943 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:03,014 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020763b045357c5c41fa9b78ce767ac6b74b_del 2023-02-07 16:58:03,015 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020763b045357c5c41fa9b78ce767ac6b74b_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023020763b045357c5c41fa9b78ce767ac6b74b_del 2023-02-07 16:58:03,032 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 848cb3500bf847aba96a15ec16c58cf2 2023-02-07 16:58:03,033 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family1/848cb3500bf847aba96a15ec16c58cf2 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/848cb3500bf847aba96a15ec16c58cf2 2023-02-07 16:58:03,037 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 848cb3500bf847aba96a15ec16c58cf2 2023-02-07 16:58:03,038 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d7073c73c9022e4ca4b7f790b115fb26/family1 of d7073c73c9022e4ca4b7f790b115fb26 into 848cb3500bf847aba96a15ec16c58cf2(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:58:03,038 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for d7073c73c9022e4ca4b7f790b115fb26: 2023-02-07 16:58:03,038 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:03,038 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): d7073c73c9022e4ca4b7f790b115fb26/family2 is initiating major compaction (all files) 2023-02-07 16:58:03,038 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:03,038 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:03,039 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of d7073c73c9022e4ca4b7f790b115fb26/family2 in ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:58:03,039 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/7d9de37fc5594f2eb9881c0a59590423, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/40ec771eb75f4ff8959583c5a0db39e0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/78956611b6cf41e08a7b3c9a09f86bdc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/5866820e86014f9abeffff863ec60bfd, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/2bd00b89baa74e5ea489c052b5277b75] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp, totalSize=25.3 K 2023-02-07 16:58:03,040 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 7d9de37fc5594f2eb9881c0a59590423, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789068959 2023-02-07 16:58:03,040 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 40ec771eb75f4ff8959583c5a0db39e0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789070879 2023-02-07 16:58:03,041 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 78956611b6cf41e08a7b3c9a09f86bdc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789072871 2023-02-07 16:58:03,041 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 5866820e86014f9abeffff863ec60bfd, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789074795 2023-02-07 16:58:03,041 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 2bd00b89baa74e5ea489c052b5277b75, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:03,049 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): d7073c73c9022e4ca4b7f790b115fb26#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:03,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/0b995a767b724daa834346338e1762ae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/41930aa1ee13482b8346425093b63a26, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/d1b0cc8b99464a08bb11f44135bfae91, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/234dd4e87a224712bb0c9658a189775e, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/cf173144c1ec4ca5ada22089e263c73f] to archive 2023-02-07 16:58:03,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:03,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/0b995a767b724daa834346338e1762ae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/0b995a767b724daa834346338e1762ae 2023-02-07 16:58:03,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/41930aa1ee13482b8346425093b63a26 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/41930aa1ee13482b8346425093b63a26 2023-02-07 16:58:03,057 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302074675c3dfd5574611b9421ec62f414f02_del 2023-02-07 16:58:03,057 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302074675c3dfd5574611b9421ec62f414f02_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302074675c3dfd5574611b9421ec62f414f02_del 2023-02-07 16:58:03,060 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/d1b0cc8b99464a08bb11f44135bfae91 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/d1b0cc8b99464a08bb11f44135bfae91 2023-02-07 16:58:03,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/234dd4e87a224712bb0c9658a189775e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/234dd4e87a224712bb0c9658a189775e 2023-02-07 16:58:03,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/cf173144c1ec4ca5ada22089e263c73f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/cf173144c1ec4ca5ada22089e263c73f 2023-02-07 16:58:03,479 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbde748b8ea442f69fbf53137256db43 2023-02-07 16:58:03,480 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/.tmp/family2/fbde748b8ea442f69fbf53137256db43 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/fbde748b8ea442f69fbf53137256db43 2023-02-07 16:58:03,486 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fbde748b8ea442f69fbf53137256db43 2023-02-07 16:58:03,487 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in d7073c73c9022e4ca4b7f790b115fb26/family2 of d7073c73c9022e4ca4b7f790b115fb26 into fbde748b8ea442f69fbf53137256db43(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:58:03,487 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for d7073c73c9022e4ca4b7f790b115fb26: 2023-02-07 16:58:03,491 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:03,495 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:03,500 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:03,501 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:03,506 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-07 16:58:03,520 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-07 16:58:03,522 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020763b045357c5c41fa9b78ce767ac6b74b_del 2023-02-07 16:58:03,525 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230207f67bb6845c14436aafc27a7b40ec7ad4_del 2023-02-07 16:58:03,528 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302073c68895df1d8422fa659af467e0d654f_del 2023-02-07 16:58:03,528 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-07 16:58:03,528 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ReadOnlyZKClient(139): Connect 0x6db26196 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:58:03,559 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/7d9de37fc5594f2eb9881c0a59590423, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/40ec771eb75f4ff8959583c5a0db39e0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/78956611b6cf41e08a7b3c9a09f86bdc, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/5866820e86014f9abeffff863ec60bfd, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/2bd00b89baa74e5ea489c052b5277b75] to archive 2023-02-07 16:58:03,560 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:03,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/7d9de37fc5594f2eb9881c0a59590423 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/7d9de37fc5594f2eb9881c0a59590423 2023-02-07 16:58:03,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/40ec771eb75f4ff8959583c5a0db39e0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/40ec771eb75f4ff8959583c5a0db39e0 2023-02-07 16:58:03,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/78956611b6cf41e08a7b3c9a09f86bdc to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/78956611b6cf41e08a7b3c9a09f86bdc 2023-02-07 16:58:03,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/5866820e86014f9abeffff863ec60bfd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/5866820e86014f9abeffff863ec60bfd 2023-02-07 16:58:03,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/2bd00b89baa74e5ea489c052b5277b75 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family2/2bd00b89baa74e5ea489c052b5277b75 2023-02-07 16:58:03,765 DEBUG [Listener at localhost.localdomain/41849] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35d730aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:58:03,767 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230207 for table='ns:testMinorCompaction' and column='family1' 2023-02-07 16:58:03,767 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230207 for table='ns:testMinorCompaction' and column='family1' 2023-02-07 16:58:03,767 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230207 for table='ns:testMinorCompaction' and column='family1' 2023-02-07 16:58:04,194 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207b5bd882bc49c4548b7ae7fb916fc5b0e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230207b5bd882bc49c4548b7ae7fb916fc5b0e 2023-02-07 16:58:04,195 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230207 table='ns:testMinorCompaction' column='family1' 2023-02-07 16:58:04,195 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020761b1110b99b6418cb42dd9d344dfc796 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020761b1110b99b6418cb42dd9d344dfc796 2023-02-07 16:58:04,196 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='ns:testMinorCompaction' column='family1' 2023-02-07 16:58:04,196 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207a4fb113b013e4410a52380ef62e70d37 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230207a4fb113b013e4410a52380ef62e70d37 2023-02-07 16:58:04,200 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='ns:testMinorCompaction' column='family1' 2023-02-07 16:58:04,210 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:58:04,213 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:40998, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:58:04,218 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,218 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,219 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,219 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:58:04,219 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,224 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39990, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:58:04,224 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,224 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:04,225 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,225 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:04,243 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230207/family1/e916a667acdc4bea8c8636ab208a6be7 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-07 16:58:04,243 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230207/family1/69e6fe0a44534efda5736e37e81165c4 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-07 16:58:04,245 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230207/family1/69e6fe0a44534efda5736e37e81165c4}] 2023-02-07 16:58:04,246 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230207/family1/e916a667acdc4bea8c8636ab208a6be7}] 2023-02-07 16:58:04,247 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230207/family1/7599fecb21d7451d90b37bbd86585bd0 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-07 16:58:04,248 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230207/family1/7599fecb21d7451d90b37bbd86585bd0}] 2023-02-07 16:58:04,250 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230207/family1/e916a667acdc4bea8c8636ab208a6be7 for inclusion in d4808dee17e59026f0dbc8ffe25e685f/family1 2023-02-07 16:58:04,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230207/family1/69e6fe0a44534efda5736e37e81165c4 for inclusion in d7073c73c9022e4ca4b7f790b115fb26/family1 2023-02-07 16:58:04,250 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230207/family1/7599fecb21d7451d90b37bbd86585bd0 for inclusion in 4744f35850a224eccfa1a64842abbd85/family1 2023-02-07 16:58:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-07 16:58:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-07 16:58:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for d4808dee17e59026f0dbc8ffe25e685f: 2023-02-07 16:58:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-07 16:58:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-07 16:58:04,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last=1 2023-02-07 16:58:04,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-07 16:58:04,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for d7073c73c9022e4ca4b7f790b115fb26: 2023-02-07 16:58:04,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 4744f35850a224eccfa1a64842abbd85: 2023-02-07 16:58:04,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230207/family1/e916a667acdc4bea8c8636ab208a6be7 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__s1km1p175p02mm05m1sc5i3s5eo4s1es8m47pd43j06rnt919rdau24osu80lgoh/family1/e916a667acdc4bea8c8636ab208a6be7 2023-02-07 16:58:04,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230207/family1/69e6fe0a44534efda5736e37e81165c4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__3vda7bqq5f793vco56p2h695of9dur4nkmpra4pos2uf5qiqr0r8a28qdhh67snc/family1/69e6fe0a44534efda5736e37e81165c4 2023-02-07 16:58:04,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230207/family1/7599fecb21d7451d90b37bbd86585bd0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__15sgdr58kh7e4jn2kjdkvunsniol5uipg990kiisjn0f1sm904hko0l3s4vfc2vu/family1/7599fecb21d7451d90b37bbd86585bd0 2023-02-07 16:58:04,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__s1km1p175p02mm05m1sc5i3s5eo4s1es8m47pd43j06rnt919rdau24osu80lgoh/family1/e916a667acdc4bea8c8636ab208a6be7 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/2e4eebbe2bd64d03972ed9e6c6222a3d_SeqId_28_ 2023-02-07 16:58:04,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__3vda7bqq5f793vco56p2h695of9dur4nkmpra4pos2uf5qiqr0r8a28qdhh67snc/family1/69e6fe0a44534efda5736e37e81165c4 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/9adfa1a60636493dbde7b43be2a04c4c_SeqId_28_ 2023-02-07 16:58:04,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__15sgdr58kh7e4jn2kjdkvunsniol5uipg990kiisjn0f1sm904hko0l3s4vfc2vu/family1/7599fecb21d7451d90b37bbd86585bd0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/9f3a786eb1cf4aaf9efdb46d759553af_SeqId_28_ 2023-02-07 16:58:04,256 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__s1km1p175p02mm05m1sc5i3s5eo4s1es8m47pd43j06rnt919rdau24osu80lgoh/family1/e916a667acdc4bea8c8636ab208a6be7 into d4808dee17e59026f0dbc8ffe25e685f/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/2e4eebbe2bd64d03972ed9e6c6222a3d_SeqId_28_ - updating store file list. 2023-02-07 16:58:04,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__3vda7bqq5f793vco56p2h695of9dur4nkmpra4pos2uf5qiqr0r8a28qdhh67snc/family1/69e6fe0a44534efda5736e37e81165c4 into d7073c73c9022e4ca4b7f790b115fb26/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/9adfa1a60636493dbde7b43be2a04c4c_SeqId_28_ - updating store file list. 2023-02-07 16:58:04,256 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__15sgdr58kh7e4jn2kjdkvunsniol5uipg990kiisjn0f1sm904hko0l3s4vfc2vu/family1/7599fecb21d7451d90b37bbd86585bd0 into 4744f35850a224eccfa1a64842abbd85/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/9f3a786eb1cf4aaf9efdb46d759553af_SeqId_28_ - updating store file list. 2023-02-07 16:58:04,259 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/2e4eebbe2bd64d03972ed9e6c6222a3d_SeqId_28_ into d4808dee17e59026f0dbc8ffe25e685f/family1 2023-02-07 16:58:04,260 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__s1km1p175p02mm05m1sc5i3s5eo4s1es8m47pd43j06rnt919rdau24osu80lgoh/family1/e916a667acdc4bea8c8636ab208a6be7 into d4808dee17e59026f0dbc8ffe25e685f/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/family1/2e4eebbe2bd64d03972ed9e6c6222a3d_SeqId_28_) 2023-02-07 16:58:04,260 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/9f3a786eb1cf4aaf9efdb46d759553af_SeqId_28_ into 4744f35850a224eccfa1a64842abbd85/family1 2023-02-07 16:58:04,260 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__15sgdr58kh7e4jn2kjdkvunsniol5uipg990kiisjn0f1sm904hko0l3s4vfc2vu/family1/7599fecb21d7451d90b37bbd86585bd0 into 4744f35850a224eccfa1a64842abbd85/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/family1/9f3a786eb1cf4aaf9efdb46d759553af_SeqId_28_) 2023-02-07 16:58:04,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/9adfa1a60636493dbde7b43be2a04c4c_SeqId_28_ into d7073c73c9022e4ca4b7f790b115fb26/family1 2023-02-07 16:58:04,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__3vda7bqq5f793vco56p2h695of9dur4nkmpra4pos2uf5qiqr0r8a28qdhh67snc/family1/69e6fe0a44534efda5736e37e81165c4 into d7073c73c9022e4ca4b7f790b115fb26/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/family1/9adfa1a60636493dbde7b43be2a04c4c_SeqId_28_) 2023-02-07 16:58:04,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__s1km1p175p02mm05m1sc5i3s5eo4s1es8m47pd43j06rnt919rdau24osu80lgoh/family1/e916a667acdc4bea8c8636ab208a6be7 2023-02-07 16:58:04,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__15sgdr58kh7e4jn2kjdkvunsniol5uipg990kiisjn0f1sm904hko0l3s4vfc2vu/family1/7599fecb21d7451d90b37bbd86585bd0 2023-02-07 16:58:04,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__ns_testMinorCompaction__3vda7bqq5f793vco56p2h695of9dur4nkmpra4pos2uf5qiqr0r8a28qdhh67snc/family1/69e6fe0a44534efda5736e37e81165c4 2023-02-07 16:58:04,262 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='ns:testMinorCompaction' column='family1' 2023-02-07 16:58:04,262 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230207 table='ns:testMinorCompaction' column='family1' 2023-02-07 16:58:04,262 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='ns:testMinorCompaction' column='family1' 2023-02-07 16:58:04,263 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:04,263 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:04,263 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:04,264 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230207fdf212bc735741e6a3f50a5af1706537 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230207fdf212bc735741e6a3f50a5af1706537 2023-02-07 16:58:04,264 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230207c2caae67a7c34794909a7d870d9c7f4a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230207c2caae67a7c34794909a7d870d9c7f4a 2023-02-07 16:58:04,264 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-07 16:58:04,264 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-07 16:58:04,264 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302076bc2978d3bad469c846c906d73903c45 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302076bc2978d3bad469c846c906d73903c45 2023-02-07 16:58:04,264 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230207' 2023-02-07 16:58:04,264 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230207' 2023-02-07 16:58:04,264 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-07 16:58:04,264 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230207' 2023-02-07 16:58:04,265 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230207 for table='ns:testMinorCompaction' and column='family1' 2023-02-07 16:58:04,265 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230207 for table='ns:testMinorCompaction' and column='family1' 2023-02-07 16:58:04,265 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230207 for table='ns:testMinorCompaction' and column='family1' 2023-02-07 16:58:04,265 INFO [Listener at localhost.localdomain/41849] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-07 16:58:04,267 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:04,269 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:04,272 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:04,273 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:04,290 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=249 (was 283), OpenFileDescriptor=630 (was 750), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 160) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 174), AvailableMemoryMB=2223 (was 2220) - AvailableMemoryMB LEAK? - 2023-02-07 16:58:04,302 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=249, OpenFileDescriptor=630, MaxFileDescriptor=60000, SystemLoadAverage=170, ProcessCount=172, AvailableMemoryMB=2223 2023-02-07 16:58:04,303 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,303 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:04,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-07 16:58:04,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,307 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:58:04,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-07 16:58:04,307 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,307 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:04,307 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:58:04,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-07 16:58:04,309 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,309 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed empty. 2023-02-07 16:58:04,309 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,310 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-07 16:58:04,317 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-07 16:58:04,318 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => fe51cee5e4e59fe002485f5979eb68ed, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:58:04,323 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:58:04,323 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing fe51cee5e4e59fe002485f5979eb68ed, disabling compactions & flushes 2023-02-07 16:58:04,323 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,323 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,323 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. after waiting 0 ms 2023-02-07 16:58:04,323 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,323 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,323 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for fe51cee5e4e59fe002485f5979eb68ed: Waiting for close lock at 1675789084323Disabling compacts and flushes for region at 1675789084323Disabling writes for close at 1675789084323Writing region close event to WAL at 1675789084323Closed at 1675789084323 2023-02-07 16:58:04,325 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:58:04,326 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675789084326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789084326"}]},"ts":"1675789084326"} 2023-02-07 16:58:04,327 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-07 16:58:04,328 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:58:04,328 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789084328"}]},"ts":"1675789084328"} 2023-02-07 16:58:04,329 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-07 16:58:04,354 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=fe51cee5e4e59fe002485f5979eb68ed, ASSIGN}] 2023-02-07 16:58:04,355 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=fe51cee5e4e59fe002485f5979eb68ed, ASSIGN 2023-02-07 16:58:04,356 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=fe51cee5e4e59fe002485f5979eb68ed, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:58:04,408 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,408 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:04,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-07 16:58:04,507 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=fe51cee5e4e59fe002485f5979eb68ed, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:04,507 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675789084507"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789084507"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789084507"}]},"ts":"1675789084507"} 2023-02-07 16:58:04,508 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure fe51cee5e4e59fe002485f5979eb68ed, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:58:04,610 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,610 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:04,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-07 16:58:04,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => fe51cee5e4e59fe002485f5979eb68ed, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed.', STARTKEY => '', ENDKEY => ''} 2023-02-07 16:58:04,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:58:04,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,669 INFO [StoreOpener-fe51cee5e4e59fe002485f5979eb68ed-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,672 DEBUG [StoreOpener-fe51cee5e4e59fe002485f5979eb68ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1 2023-02-07 16:58:04,672 DEBUG [StoreOpener-fe51cee5e4e59fe002485f5979eb68ed-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1 2023-02-07 16:58:04,673 INFO [StoreOpener-fe51cee5e4e59fe002485f5979eb68ed-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe51cee5e4e59fe002485f5979eb68ed columnFamilyName family1 2023-02-07 16:58:04,674 INFO [StoreOpener-fe51cee5e4e59fe002485f5979eb68ed-1] regionserver.HStore(310): Store=fe51cee5e4e59fe002485f5979eb68ed/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:58:04,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:04,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:58:04,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened fe51cee5e4e59fe002485f5979eb68ed; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61031425, jitterRate=-0.0905608981847763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-07 16:58:04,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for fe51cee5e4e59fe002485f5979eb68ed: Running coprocessor pre-open hook at 1675789084667Writing region info on filesystem at 1675789084667Initializing all the Stores at 1675789084668 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675789084669 (+1 ms)Cleaning up temporary data from old regions at 1675789084677 (+8 ms)Cleaning up detritus from prior splits at 1675789084677Running coprocessor post-open hooks at 1675789084683 (+6 ms)Region opened successfully at 1675789084683 2023-02-07 16:58:04,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed., pid=114, masterSystemTime=1675789084660 2023-02-07 16:58:04,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,686 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=fe51cee5e4e59fe002485f5979eb68ed, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:04,687 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675789084686"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789084686"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789084686"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789084686"}]},"ts":"1675789084686"} 2023-02-07 16:58:04,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-07 16:58:04,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure fe51cee5e4e59fe002485f5979eb68ed, server=jenkins-hbase12.apache.org,33237,1675788923983 in 180 msec 2023-02-07 16:58:04,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-07 16:58:04,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=fe51cee5e4e59fe002485f5979eb68ed, ASSIGN in 337 msec 2023-02-07 16:58:04,693 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:58:04,693 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789084693"}]},"ts":"1675789084693"} 2023-02-07 16:58:04,695 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-07 16:58:04,756 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:58:04,760 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 451 msec 2023-02-07 16:58:04,912 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,912 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:04,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-07 16:58:04,915 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-07 16:58:04,940 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:04,941 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:04,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:04,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,943 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:04,943 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:04,943 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:04,943 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:04,943 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,943 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,954 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:04,954 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:04,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:04,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:04,954 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:04,954 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:04,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:04,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,955 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,955 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:04,955 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,955 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:04,956 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-07 16:58:04,979 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113020db53c062984143ad9dbee24283871f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113020db53c062984143ad9dbee24283871f 2023-02-07 16:58:04,982 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/4d35190c9a3f4d469a50e20566040ff3 2023-02-07 16:58:04,986 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/4d35190c9a3f4d469a50e20566040ff3 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/4d35190c9a3f4d469a50e20566040ff3 2023-02-07 16:58:04,989 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/4d35190c9a3f4d469a50e20566040ff3, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-07 16:58:04,990 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 34ms, sequenceid=5, compaction requested=false 2023-02-07 16:58:04,990 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:04,990 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:04,990 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:04,991 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:04,991 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:04,991 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:04,991 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:04,991 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:04,996 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:04,996 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:04,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:04,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:04,996 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,996 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:04,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:04,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:04,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:04,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:04,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:04,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10b006b0[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:04,997 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:04,997 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,006 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,006 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:05,006 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:05,006 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:05,006 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,007 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:05,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:05,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:05,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:05,017 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:05,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:05,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:05,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:05,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:05,021 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:05,021 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:05,021 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:05,021 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,021 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:05,027 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,027 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,027 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:05,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:05,028 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:05,028 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:05,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:05,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,030 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:05,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:05,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:05,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:05,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:05,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:05,038 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:05,039 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:58:05,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:05,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,039 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:05,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:05,039 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:05,039 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:05,039 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,140 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:05,140 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:05,140 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:05,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:05,152 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:05,153 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:05,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:05,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:05,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,156 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:05,156 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:05,156 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:05,156 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:05,157 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,157 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,164 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,164 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:05,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:05,165 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:05,165 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:05,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,166 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:05,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,168 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,168 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:05,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:05,168 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:05,168 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:05,168 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:05,169 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:05,169 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:05,169 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:05,169 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:05,169 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-07 16:58:05,593 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128dcb3f2be870448f0a87766d955354170 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128dcb3f2be870448f0a87766d955354170 2023-02-07 16:58:06,001 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/7453f5ec7fa1475eb9fda7af06a78138 2023-02-07 16:58:06,011 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/7453f5ec7fa1475eb9fda7af06a78138 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7453f5ec7fa1475eb9fda7af06a78138 2023-02-07 16:58:06,015 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7453f5ec7fa1475eb9fda7af06a78138, entries=1, sequenceid=9, filesize=5.0 K 2023-02-07 16:58:06,016 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 847ms, sequenceid=9, compaction requested=false 2023-02-07 16:58:06,017 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:06,017 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:06,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:06,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:06,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:06,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:06,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,038 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:06,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:06,039 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,039 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:06,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:06,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:06,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:06,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b1ead41[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:06,043 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:06,043 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,048 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,049 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:06,049 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:06,049 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:06,049 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,049 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:06,059 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:06,059 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,059 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:06,059 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:06,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:06,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:06,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:06,069 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:06,069 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:06,069 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:06,069 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,069 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:06,080 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,080 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,080 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:06,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:06,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:06,082 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:06,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:06,085 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:06,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,130 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,130 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,130 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,130 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:06,130 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:06,130 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:06,130 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:06,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:06,130 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:06,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:06,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:58:06,131 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,131 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:06,131 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:06,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:06,132 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:06,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,233 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:06,233 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:06,233 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:06,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:06,243 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:06,244 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:06,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:06,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:06,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,247 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:06,247 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:06,247 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:06,247 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:06,247 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,248 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,269 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:06,269 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:06,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:06,270 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,270 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:06,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:06,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,271 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,271 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:06,271 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,271 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:06,271 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:06,271 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:06,271 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:06,271 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:06,271 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:06,271 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:06,271 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:58:06,684 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512015050efa40099427289e9e0fce59686dd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512015050efa40099427289e9e0fce59686dd 2023-02-07 16:58:06,691 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/3d1cc5a6fc9f4d1e97288fa9ae745f3f 2023-02-07 16:58:06,695 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/3d1cc5a6fc9f4d1e97288fa9ae745f3f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/3d1cc5a6fc9f4d1e97288fa9ae745f3f 2023-02-07 16:58:06,699 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/3d1cc5a6fc9f4d1e97288fa9ae745f3f, entries=1, sequenceid=13, filesize=4.9 K 2023-02-07 16:58:06,700 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 429ms, sequenceid=13, compaction requested=true 2023-02-07 16:58:06,700 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:06,701 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:06,701 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:06,701 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:06,701 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,701 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:06,701 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:06,764 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,764 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:06,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:06,765 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,765 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:06,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:06,767 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f7d08b8[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:06,767 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:06,767 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,775 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,775 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:06,775 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:06,775 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:06,775 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,775 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:06,785 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:06,785 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,785 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:06,786 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:06,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:06,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:06,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:06,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:06,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:06,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:06,792 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:06,792 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:06,792 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:06,792 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,792 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:06,805 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,805 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:06,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,805 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:06,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:06,806 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,806 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:06,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:06,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:06,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:06,810 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:06,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:06,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:06,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:06,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:06,817 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:06,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:58:06,817 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:06,818 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:06,918 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:06,918 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:06,918 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:06,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:06,927 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:06,927 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:06,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:06,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:06,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,931 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:06,931 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:06,931 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:06,931 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:06,932 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,932 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,943 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:06,943 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:06,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:06,943 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:06,943 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:06,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:06,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,944 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,945 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:06,945 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:06,945 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:06,945 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:06,945 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:06,945 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:06,945 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:06,945 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:06,945 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:06,945 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:58:07,364 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120555b4700942914c57aa07398cee020170 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120555b4700942914c57aa07398cee020170 2023-02-07 16:58:07,770 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/1fb57ee1e420491da89b63cdd5bd80ad 2023-02-07 16:58:07,780 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/1fb57ee1e420491da89b63cdd5bd80ad as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1fb57ee1e420491da89b63cdd5bd80ad 2023-02-07 16:58:07,788 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1fb57ee1e420491da89b63cdd5bd80ad, entries=1, sequenceid=17, filesize=4.9 K 2023-02-07 16:58:07,790 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 845ms, sequenceid=17, compaction requested=true 2023-02-07 16:58:07,790 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:07,790 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:07,790 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:07,790 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:07,790 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,791 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:07,791 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:07,838 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,838 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:07,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:07,839 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,839 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:07,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:07,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:07,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:07,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:07,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@408762b3[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:07,844 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:07,844 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,848 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:07,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:07,849 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,849 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:07,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:07,859 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:07,859 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:07,859 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,859 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:07,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:07,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:07,869 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:07,869 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:07,869 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:07,869 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,869 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:07,880 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,880 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,880 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:07,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:07,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:07,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:07,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:07,882 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:07,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:07,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,884 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:58:07,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:07,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:07,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:07,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:07,900 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:07,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:07,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:07,900 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:07,901 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,001 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:08,001 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:08,001 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:08,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:08,004 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:08,004 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:08,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:08,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:08,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,007 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:08,007 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:08,007 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:08,007 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:08,008 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,008 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,016 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:08,016 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:08,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:08,017 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:08,017 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:08,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:08,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,018 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,018 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:08,018 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:08,018 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:08,018 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:08,018 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:08,019 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:08,019 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:08,019 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:08,019 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:08,019 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:58:08,434 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228fd95cf50d6de451e9966d74e345157ce to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fd95cf50d6de451e9966d74e345157ce 2023-02-07 16:58:08,838 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/29a4befa588e401c90f8d21b59b8a738 2023-02-07 16:58:08,844 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/29a4befa588e401c90f8d21b59b8a738 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/29a4befa588e401c90f8d21b59b8a738 2023-02-07 16:58:08,848 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/29a4befa588e401c90f8d21b59b8a738, entries=1, sequenceid=21, filesize=4.9 K 2023-02-07 16:58:08,849 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 830ms, sequenceid=21, compaction requested=true 2023-02-07 16:58:08,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:08,849 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:08,849 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:08,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:08,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:08,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:08,850 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:09,017 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,017 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:09,018 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,018 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:09,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:09,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:09,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:09,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:09,024 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50927995[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:09,025 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:09,025 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,038 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:09,038 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:09,038 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:09,039 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,039 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:09,048 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,048 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:09,048 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:09,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:09,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:09,049 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:09,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:09,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:09,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:09,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:09,056 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:09,056 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:09,057 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:09,057 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,057 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:09,099 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,100 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:09,099 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:09,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:09,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:09,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:09,101 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:09,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:09,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,106 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:09,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,131 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,131 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:09,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:09,132 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:09,132 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:58:09,131 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:09,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:09,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:09,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:09,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,132 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:09,133 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:09,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:09,233 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:09,233 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:09,233 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:09,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:09,244 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:09,244 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:09,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:09,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:09,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,248 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:09,249 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:09,249 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:09,249 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:09,250 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,250 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,259 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,259 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:09,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:09,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:09,259 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:09,259 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:09,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:09,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,261 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,261 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:09,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:09,261 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:09,261 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:09,261 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:09,261 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:09,261 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:09,261 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:09,261 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:09,262 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:58:09,679 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cebe129fe75044de8552d8f6dbb1f429 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231cebe129fe75044de8552d8f6dbb1f429 2023-02-07 16:58:10,084 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/ffb64215e5f74400b9e993eb9af463c0 2023-02-07 16:58:10,096 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/ffb64215e5f74400b9e993eb9af463c0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/ffb64215e5f74400b9e993eb9af463c0 2023-02-07 16:58:10,100 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/ffb64215e5f74400b9e993eb9af463c0, entries=1, sequenceid=25, filesize=4.9 K 2023-02-07 16:58:10,101 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 839ms, sequenceid=25, compaction requested=true 2023-02-07 16:58:10,101 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:10,101 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:10,101 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:10,101 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:10,101 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,101 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:10,102 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:10,153 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,153 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:10,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:10,154 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,154 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:10,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:10,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:10,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:10,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:10,156 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6ed8a263[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:10,156 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:10,157 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,164 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,164 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:10,164 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:10,164 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:10,164 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,164 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:10,174 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:10,174 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,174 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:10,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:10,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:10,175 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:10,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:10,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:10,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:10,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:10,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:10,181 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:10,181 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:10,181 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:10,181 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,181 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:10,194 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,194 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:10,194 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:10,195 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:10,196 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:10,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:10,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:10,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:10,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:10,206 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:10,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:58:10,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:10,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:10,206 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,207 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,207 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,209 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:58:10,307 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:10,307 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:10,307 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:10,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:10,310 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:10,310 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:10,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:10,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:10,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,312 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:10,312 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:10,313 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:10,313 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:10,313 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,313 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,322 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:10,322 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:10,322 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:10,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,322 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:10,322 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:10,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,323 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,323 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:10,323 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:10,323 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:10,323 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:10,323 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:10,323 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:10,323 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:10,323 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:10,323 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:10,323 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:58:10,739 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101eb92099e5d50451099a13236ab36ce8a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101eb92099e5d50451099a13236ab36ce8a 2023-02-07 16:58:11,145 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/7f26cd858e914bd7b7e667662dde2dcb 2023-02-07 16:58:11,150 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/7f26cd858e914bd7b7e667662dde2dcb as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7f26cd858e914bd7b7e667662dde2dcb 2023-02-07 16:58:11,153 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7f26cd858e914bd7b7e667662dde2dcb, entries=1, sequenceid=29, filesize=4.9 K 2023-02-07 16:58:11,153 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 830ms, sequenceid=29, compaction requested=true 2023-02-07 16:58:11,153 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:11,153 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:11,153 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:11,154 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:11,154 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,154 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:11,154 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:11,258 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,258 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:11,259 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:11,259 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:11,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:11,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:11,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19975fc8[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:11,263 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:11,263 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,269 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:11,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:11,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:11,270 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,270 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:11,280 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:11,280 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,280 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:11,280 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:11,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:11,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:11,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:11,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:11,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:11,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:11,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:11,289 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:11,289 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:11,289 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:11,289 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,289 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:11,301 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,301 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:11,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,301 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:11,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:11,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:11,303 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:11,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:11,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,307 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:11,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,322 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,322 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:11,322 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:11,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:11,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:11,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:11,322 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:11,322 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,322 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:11,323 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:11,323 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:11,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:11,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:11,323 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,323 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,323 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,324 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,423 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:11,423 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:11,424 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:11,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:11,430 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:11,431 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:11,432 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:11,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:11,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,434 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:11,434 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:11,435 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:11,435 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:11,435 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,436 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,448 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,448 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:11,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:11,449 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,449 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,450 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,452 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,452 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:11,452 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,452 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:11,452 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:11,452 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:11,453 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:11,453 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:11,453 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:11,453 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:11,453 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:58:11,472 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103efc8ad952d35414098e95a725a017aa9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103efc8ad952d35414098e95a725a017aa9 2023-02-07 16:58:11,879 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/db8eda77f4a442749f7899dd5104ace8 2023-02-07 16:58:11,889 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/db8eda77f4a442749f7899dd5104ace8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/db8eda77f4a442749f7899dd5104ace8 2023-02-07 16:58:11,896 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/db8eda77f4a442749f7899dd5104ace8, entries=1, sequenceid=33, filesize=4.9 K 2023-02-07 16:58:11,897 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 444ms, sequenceid=33, compaction requested=true 2023-02-07 16:58:11,897 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:11,897 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:11,897 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:11,898 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:11,898 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,898 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:11,898 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:11,943 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,943 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:11,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:11,944 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,944 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:11,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:11,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:11,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:11,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:11,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@62fe34b3[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:11,949 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:11,950 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,963 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:11,963 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:11,963 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:11,963 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:11,964 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:11,964 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:12,006 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:12,006 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:12,006 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:12,006 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:12,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:12,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:12,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:12,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:12,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:12,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:12,017 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:12,017 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:12,017 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:12,017 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,017 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:12,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:12,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:12,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,038 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:12,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:12,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:12,039 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:12,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,042 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:12,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,058 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:12,058 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,058 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,058 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:12,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:12,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:12,058 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:12,058 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-07 16:58:12,058 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:12,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:12,058 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,059 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,059 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:12,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:12,059 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,060 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,059 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:12,060 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:12,160 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:12,161 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:12,161 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:12,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:12,170 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:12,171 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:12,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:12,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:12,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,173 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:12,173 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:12,173 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:12,173 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:12,174 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,174 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,185 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,185 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:12,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:12,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:12,186 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:12,186 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:12,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:12,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,188 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,188 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:12,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:12,188 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:12,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:12,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:12,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:12,189 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:12,189 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:12,189 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:12,189 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:58:12,615 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f68ed811b3e649f9937608c6d4d789b0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907f68ed811b3e649f9937608c6d4d789b0 2023-02-07 16:58:13,022 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/af0f7d64924746ce85ade19477e1dcf6 2023-02-07 16:58:13,033 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/af0f7d64924746ce85ade19477e1dcf6 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/af0f7d64924746ce85ade19477e1dcf6 2023-02-07 16:58:13,038 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/af0f7d64924746ce85ade19477e1dcf6, entries=1, sequenceid=37, filesize=4.9 K 2023-02-07 16:58:13,039 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 850ms, sequenceid=37, compaction requested=true 2023-02-07 16:58:13,039 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:13,039 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:13,039 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:13,039 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:13,039 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,039 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:13,039 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:13,090 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,090 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:13,091 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,091 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:13,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:13,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:13,095 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:13,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2163a7a8[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:13,096 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:13,096 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,101 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,101 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:13,101 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:13,101 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:13,101 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,101 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:13,111 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:13,111 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:13,111 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:13,111 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:13,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:13,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:13,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:13,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:13,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:13,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:13,116 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:13,116 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:13,116 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:13,116 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,116 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:13,122 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,122 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,122 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:13,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:13,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:13,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:13,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:13,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:13,122 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:13,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,124 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:13,132 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:13,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:13,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:13,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:13,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:13,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:13,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,132 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:13,132 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,133 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:13,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:13,133 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:13,133 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,133 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,233 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:13,233 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:13,233 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:13,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:13,240 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:13,240 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:13,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:13,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:13,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,245 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:13,245 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:13,245 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-07 16:58:13,245 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-07 16:58:13,246 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,246 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,259 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:13,259 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:13,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:13,259 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:13,260 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:13,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,261 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:13,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,262 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-07 16:58:13,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:13,263 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-07 16:58:13,263 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:13,263 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-07 16:58:13,263 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-07 16:58:13,263 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:13,263 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:13,263 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. started... 2023-02-07 16:58:13,264 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing fe51cee5e4e59fe002485f5979eb68ed 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-07 16:58:13,683 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205105602fce5240d38d4771f6ae2a099e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205105602fce5240d38d4771f6ae2a099e 2023-02-07 16:58:14,091 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/d2185f08cd724efaaeededff42cc3eed 2023-02-07 16:58:14,098 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/d2185f08cd724efaaeededff42cc3eed as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/d2185f08cd724efaaeededff42cc3eed 2023-02-07 16:58:14,103 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/d2185f08cd724efaaeededff42cc3eed, entries=1, sequenceid=41, filesize=4.9 K 2023-02-07 16:58:14,104 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fe51cee5e4e59fe002485f5979eb68ed in 840ms, sequenceid=41, compaction requested=true 2023-02-07 16:58:14,105 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:14,105 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:14,105 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-07 16:58:14,105 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-07 16:58:14,105 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,105 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-07 16:58:14,105 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-07 16:58:14,164 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,164 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:14,164 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,164 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:14,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:14,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:14,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:14,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-07 16:58:14,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a03d25d[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:14,168 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-07 16:58:14,168 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,174 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,175 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-07 16:58:14,175 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-07 16:58:14,175 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:14,175 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,175 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:14,185 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-07 16:58:14,185 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,185 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:14,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:14,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:14,185 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-07 16:58:14,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:14,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:14,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:14,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:14,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-07 16:58:14,193 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-07 16:58:14,193 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:14,194 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:14,194 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,194 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:14,257 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,257 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,257 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:14,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:14,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:14,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:14,259 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:14,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,264 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:14,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,290 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,290 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:14,290 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:14,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:14,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:14,290 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-07 16:58:14,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:14,290 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:14,290 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,291 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:14,291 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,291 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:14,291 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:14,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:14,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:14,291 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,291 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,391 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:14,392 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:14,392 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:14,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:14,396 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-07 16:58:14,397 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:58:14,398 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:58:14,398 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:58:14,398 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789694398 2023-02-07 16:58:14,401 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-07 16:58:14,401 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-07 16:58:14,402 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:58:14,402 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x5d453689 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:58:14,416 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bf3056f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:58:14,417 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:58:15,245 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033aa72d49b11c4ae097868bf82c4f4bc5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601033aa72d49b11c4ae097868bf82c4f4bc5 2023-02-07 16:58:15,246 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:58:15,259 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:58:15,261 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56820, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:58:15,266 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:15,267 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:15,267 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:58:15,268 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:43272, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:58:15,275 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a34bcd380ff748c99901bed40985b3da first=Optional[r5] last=Optional[r6] 2023-02-07 16:58:15,276 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a34bcd380ff748c99901bed40985b3da}] 2023-02-07 16:58:15,280 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a34bcd380ff748c99901bed40985b3da for inclusion in fe51cee5e4e59fe002485f5979eb68ed/family1 2023-02-07 16:58:15,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-07 16:58:15,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:58:15,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:15,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/a34bcd380ff748c99901bed40985b3da to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9h6akvn0uoqbj1lrak4eec564dqfqobdco54dkkve6ofn03dtbadecejdu7f7pr5/family1/a34bcd380ff748c99901bed40985b3da 2023-02-07 16:58:15,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9h6akvn0uoqbj1lrak4eec564dqfqobdco54dkkve6ofn03dtbadecejdu7f7pr5/family1/a34bcd380ff748c99901bed40985b3da as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1f2f4ce0e39e442a848d5799661c558d_SeqId_44_ 2023-02-07 16:58:15,285 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9h6akvn0uoqbj1lrak4eec564dqfqobdco54dkkve6ofn03dtbadecejdu7f7pr5/family1/a34bcd380ff748c99901bed40985b3da into fe51cee5e4e59fe002485f5979eb68ed/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1f2f4ce0e39e442a848d5799661c558d_SeqId_44_ - updating store file list. 2023-02-07 16:58:15,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1f2f4ce0e39e442a848d5799661c558d_SeqId_44_ into fe51cee5e4e59fe002485f5979eb68ed/family1 2023-02-07 16:58:15,288 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9h6akvn0uoqbj1lrak4eec564dqfqobdco54dkkve6ofn03dtbadecejdu7f7pr5/family1/a34bcd380ff748c99901bed40985b3da into fe51cee5e4e59fe002485f5979eb68ed/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1f2f4ce0e39e442a848d5799661c558d_SeqId_44_) 2023-02-07 16:58:15,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__9h6akvn0uoqbj1lrak4eec564dqfqobdco54dkkve6ofn03dtbadecejdu7f7pr5/family1/a34bcd380ff748c99901bed40985b3da 2023-02-07 16:58:15,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-07 16:58:15,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-07 16:58:15,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(1912): fe51cee5e4e59fe002485f5979eb68ed/family1 is initiating minor compaction 2023-02-07 16:58:15,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7d219ea2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:58:15,292 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of fe51cee5e4e59fe002485f5979eb68ed/family1 in testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:15,292 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7453f5ec7fa1475eb9fda7af06a78138, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/3d1cc5a6fc9f4d1e97288fa9ae745f3f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1fb57ee1e420491da89b63cdd5bd80ad, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/29a4befa588e401c90f8d21b59b8a738, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/ffb64215e5f74400b9e993eb9af463c0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7f26cd858e914bd7b7e667662dde2dcb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/db8eda77f4a442749f7899dd5104ace8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/af0f7d64924746ce85ade19477e1dcf6, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/d2185f08cd724efaaeededff42cc3eed, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1f2f4ce0e39e442a848d5799661c558d_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp, totalSize=49.7 K 2023-02-07 16:58:15,292 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 7453f5ec7fa1475eb9fda7af06a78138, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-07 16:58:15,292 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 3d1cc5a6fc9f4d1e97288fa9ae745f3f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-07 16:58:15,292 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 1fb57ee1e420491da89b63cdd5bd80ad, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-07 16:58:15,292 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 29a4befa588e401c90f8d21b59b8a738, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-07 16:58:15,292 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting ffb64215e5f74400b9e993eb9af463c0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-07 16:58:15,292 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 7f26cd858e914bd7b7e667662dde2dcb, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-07 16:58:15,292 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting db8eda77f4a442749f7899dd5104ace8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-07 16:58:15,293 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting af0f7d64924746ce85ade19477e1dcf6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-07 16:58:15,293 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting d2185f08cd724efaaeededff42cc3eed, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-07 16:58:15,293 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 1f2f4ce0e39e442a848d5799661c558d_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-07 16:58:15,294 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:58:15,294 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:15,296 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101eb92099e5d50451099a13236ab36ce8a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101eb92099e5d50451099a13236ab36ce8a 2023-02-07 16:58:15,297 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103efc8ad952d35414098e95a725a017aa9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103efc8ad952d35414098e95a725a017aa9 2023-02-07 16:58:15,297 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-07 16:58:15,297 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-07 16:58:15,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:58:15,298 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:58:15,313 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): fe51cee5e4e59fe002485f5979eb68ed#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:16,130 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/6911b7e0268d496d995a371dbdb816e6 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/6911b7e0268d496d995a371dbdb816e6 2023-02-07 16:58:16,136 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fe51cee5e4e59fe002485f5979eb68ed/family1 of fe51cee5e4e59fe002485f5979eb68ed into 6911b7e0268d496d995a371dbdb816e6(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:58:16,136 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:16,136 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675789095292; duration=0sec 2023-02-07 16:58:16,136 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:58:16,140 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b44229efd428474cb0d8523dade0a765 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231b44229efd428474cb0d8523dade0a765 2023-02-07 16:58:16,140 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:58:16,153 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:16,153 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:16,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7453f5ec7fa1475eb9fda7af06a78138, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/3d1cc5a6fc9f4d1e97288fa9ae745f3f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1fb57ee1e420491da89b63cdd5bd80ad, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/29a4befa588e401c90f8d21b59b8a738, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/ffb64215e5f74400b9e993eb9af463c0, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7f26cd858e914bd7b7e667662dde2dcb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/db8eda77f4a442749f7899dd5104ace8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/af0f7d64924746ce85ade19477e1dcf6, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/d2185f08cd724efaaeededff42cc3eed, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1f2f4ce0e39e442a848d5799661c558d_SeqId_44_] to archive 2023-02-07 16:58:16,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:16,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7453f5ec7fa1475eb9fda7af06a78138 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7453f5ec7fa1475eb9fda7af06a78138 2023-02-07 16:58:16,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/3d1cc5a6fc9f4d1e97288fa9ae745f3f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/3d1cc5a6fc9f4d1e97288fa9ae745f3f 2023-02-07 16:58:16,159 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/0f497bae06d94784a1bcf6b0e4959d07 first=Optional[r1] last=Optional[r4] 2023-02-07 16:58:16,160 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/0f497bae06d94784a1bcf6b0e4959d07}] 2023-02-07 16:58:16,160 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1fb57ee1e420491da89b63cdd5bd80ad to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1fb57ee1e420491da89b63cdd5bd80ad 2023-02-07 16:58:16,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/29a4befa588e401c90f8d21b59b8a738 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/29a4befa588e401c90f8d21b59b8a738 2023-02-07 16:58:16,162 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/0f497bae06d94784a1bcf6b0e4959d07 for inclusion in fe51cee5e4e59fe002485f5979eb68ed/family1 2023-02-07 16:58:16,163 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/ffb64215e5f74400b9e993eb9af463c0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/ffb64215e5f74400b9e993eb9af463c0 2023-02-07 16:58:16,164 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7f26cd858e914bd7b7e667662dde2dcb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/7f26cd858e914bd7b7e667662dde2dcb 2023-02-07 16:58:16,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-07 16:58:16,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:58:16,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:16,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/db8eda77f4a442749f7899dd5104ace8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/db8eda77f4a442749f7899dd5104ace8 2023-02-07 16:58:16,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/0f497bae06d94784a1bcf6b0e4959d07 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e5midma1j95lv0m0pumubq689vtaptgpfrklrbobm1jk1t47jkqtg2l0d2899hk0/family1/0f497bae06d94784a1bcf6b0e4959d07 2023-02-07 16:58:16,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/af0f7d64924746ce85ade19477e1dcf6 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/af0f7d64924746ce85ade19477e1dcf6 2023-02-07 16:58:16,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e5midma1j95lv0m0pumubq689vtaptgpfrklrbobm1jk1t47jkqtg2l0d2899hk0/family1/0f497bae06d94784a1bcf6b0e4959d07 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/b39327a711ae438f9c312d6c03828db0_SeqId_47_ 2023-02-07 16:58:16,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/d2185f08cd724efaaeededff42cc3eed to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/d2185f08cd724efaaeededff42cc3eed 2023-02-07 16:58:16,167 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e5midma1j95lv0m0pumubq689vtaptgpfrklrbobm1jk1t47jkqtg2l0d2899hk0/family1/0f497bae06d94784a1bcf6b0e4959d07 into fe51cee5e4e59fe002485f5979eb68ed/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/b39327a711ae438f9c312d6c03828db0_SeqId_47_ - updating store file list. 2023-02-07 16:58:16,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1f2f4ce0e39e442a848d5799661c558d_SeqId_44_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/1f2f4ce0e39e442a848d5799661c558d_SeqId_44_ 2023-02-07 16:58:16,170 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/b39327a711ae438f9c312d6c03828db0_SeqId_47_ into fe51cee5e4e59fe002485f5979eb68ed/family1 2023-02-07 16:58:16,170 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e5midma1j95lv0m0pumubq689vtaptgpfrklrbobm1jk1t47jkqtg2l0d2899hk0/family1/0f497bae06d94784a1bcf6b0e4959d07 into fe51cee5e4e59fe002485f5979eb68ed/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/b39327a711ae438f9c312d6c03828db0_SeqId_47_) 2023-02-07 16:58:16,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__e5midma1j95lv0m0pumubq689vtaptgpfrklrbobm1jk1t47jkqtg2l0d2899hk0/family1/0f497bae06d94784a1bcf6b0e4959d07 2023-02-07 16:58:16,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-07 16:58:16,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-07 16:58:16,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(1912): fe51cee5e4e59fe002485f5979eb68ed/family1 is initiating minor compaction (all files) 2023-02-07 16:58:16,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@70ceb26a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:58:16,171 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of fe51cee5e4e59fe002485f5979eb68ed/family1 in testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:16,171 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/4d35190c9a3f4d469a50e20566040ff3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/6911b7e0268d496d995a371dbdb816e6, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/b39327a711ae438f9c312d6c03828db0_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp, totalSize=178.1 K 2023-02-07 16:58:16,171 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 4d35190c9a3f4d469a50e20566040ff3, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878828694 2023-02-07 16:58:16,172 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting 6911b7e0268d496d995a371dbdb816e6, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621228694 2023-02-07 16:58:16,172 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] compactions.Compactor(207): Compacting b39327a711ae438f9c312d6c03828db0_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965228694 2023-02-07 16:58:16,173 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:58:16,173 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:16,174 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512015050efa40099427289e9e0fce59686dd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512015050efa40099427289e9e0fce59686dd 2023-02-07 16:58:16,175 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120555b4700942914c57aa07398cee020170 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120555b4700942914c57aa07398cee020170 2023-02-07 16:58:16,176 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fd95cf50d6de451e9966d74e345157ce to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228fd95cf50d6de451e9966d74e345157ce 2023-02-07 16:58:16,178 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231cebe129fe75044de8552d8f6dbb1f429 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231cebe129fe75044de8552d8f6dbb1f429 2023-02-07 16:58:16,178 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-07 16:58:16,178 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-07 16:58:16,178 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:58:16,178 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:58:16,194 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] throttle.PressureAwareThroughputController(145): fe51cee5e4e59fe002485f5979eb68ed#family1#compaction#167 average throughput is 10.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:16,622 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ddacd0b346f24366b9100d3c65c91071 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130ddacd0b346f24366b9100d3c65c91071 2023-02-07 16:58:16,623 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:58:16,639 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:16,639 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:16,644 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a4f69f1500f4f7cb9369b22b217c427 first=Optional[r00] last=Optional[r8] 2023-02-07 16:58:16,645 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a4f69f1500f4f7cb9369b22b217c427}] 2023-02-07 16:58:16,647 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a4f69f1500f4f7cb9369b22b217c427 for inclusion in fe51cee5e4e59fe002485f5979eb68ed/family1 2023-02-07 16:58:16,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-07 16:58:16,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last= 2023-02-07 16:58:16,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:16,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/7a4f69f1500f4f7cb9369b22b217c427 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f2opeidrm16cf4uv74ariu6nqhkvearjo3b1jr11bet572n5k3ll1lfdf972fnsm/family1/7a4f69f1500f4f7cb9369b22b217c427 2023-02-07 16:58:16,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f2opeidrm16cf4uv74ariu6nqhkvearjo3b1jr11bet572n5k3ll1lfdf972fnsm/family1/7a4f69f1500f4f7cb9369b22b217c427 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/82ee75ed47e942f295f6d4848c0e4345_SeqId_49_ 2023-02-07 16:58:16,652 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f2opeidrm16cf4uv74ariu6nqhkvearjo3b1jr11bet572n5k3ll1lfdf972fnsm/family1/7a4f69f1500f4f7cb9369b22b217c427 into fe51cee5e4e59fe002485f5979eb68ed/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/82ee75ed47e942f295f6d4848c0e4345_SeqId_49_ - updating store file list. 2023-02-07 16:58:16,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/82ee75ed47e942f295f6d4848c0e4345_SeqId_49_ into fe51cee5e4e59fe002485f5979eb68ed/family1 2023-02-07 16:58:16,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f2opeidrm16cf4uv74ariu6nqhkvearjo3b1jr11bet572n5k3ll1lfdf972fnsm/family1/7a4f69f1500f4f7cb9369b22b217c427 into fe51cee5e4e59fe002485f5979eb68ed/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/82ee75ed47e942f295f6d4848c0e4345_SeqId_49_) 2023-02-07 16:58:16,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMinorCompactionWithMonthlyPolicy__f2opeidrm16cf4uv74ariu6nqhkvearjo3b1jr11bet572n5k3ll1lfdf972fnsm/family1/7a4f69f1500f4f7cb9369b22b217c427 2023-02-07 16:58:16,657 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:58:16,658 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:16,659 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205105602fce5240d38d4771f6ae2a099e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511205105602fce5240d38d4771f6ae2a099e 2023-02-07 16:58:16,660 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128dcb3f2be870448f0a87766d955354170 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128dcb3f2be870448f0a87766d955354170 2023-02-07 16:58:16,660 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113020db53c062984143ad9dbee24283871f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113020db53c062984143ad9dbee24283871f 2023-02-07 16:58:16,660 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-07 16:58:16,660 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-07 16:58:16,661 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:58:16,661 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:58:16,661 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-07 16:58:16,661 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-07 16:58:16,661 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:58:16,663 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-07 16:58:16,664 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.2670 sec 2023-02-07 16:58:16,848 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=259 (was 249) - Thread LEAK? -, OpenFileDescriptor=641 (was 630) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=144 (was 170), ProcessCount=172 (was 172), AvailableMemoryMB=2209 (was 2223) 2023-02-07 16:58:16,859 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=256, OpenFileDescriptor=641, MaxFileDescriptor=60000, SystemLoadAverage=144, ProcessCount=172, AvailableMemoryMB=2209 2023-02-07 16:58:16,875 DEBUG [Listener at localhost.localdomain/41849] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-07 16:58:16,895 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:16,895 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:16,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCD\xB5dNxK\xB7U\xB0H\x16=]u;M"\x10\xDD\xEC\xE5T\x9F\xEF\x04P\xB4|\x10\x8Bc\x9D\xD6\x05*\x10{\x0D\xBEp\x8C\x00\x18Y\xC1\x01F\xA3\xEAo\xA1\x952\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-07 16:58:16,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-07 16:58:16,924 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-07 16:58:16,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-07 16:58:16,924 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:16,924 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-07 16:58:16,924 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:16,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b empty. 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f empty. 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb empty. 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:16,927 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:16,928 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-07 16:58:17,026 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:17,026 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:17,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-07 16:58:17,228 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:17,228 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:17,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-07 16:58:17,337 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-07 16:58:17,340 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => 8a8e19ead3970bd8c6eeb1c402ba852b, NAME => 'testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCD\xB5dNxK\xB7U\xB0H\x16=]u;M"\x10\xDD\xEC\xE5T\x9F\xEF\x04P\xB4|\x10\x8Bc\x9D\xD6\x05*\x10{\x0D\xBEp\x8C\x00\x18Y\xC1\x01F\xA3\xEAo\xA1\x952\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:58:17,341 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 212d6d3dadb5a739a08cab2b6aa9bafb, NAME => 'testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCD\xB5dNxK\xB7U\xB0H\x16=]u;M"\x10\xDD\xEC\xE5T\x9F\xEF\x04P\xB4|\x10\x8Bc\x9D\xD6\x05*\x10{\x0D\xBEp\x8C\x00\x18Y\xC1\x01F\xA3\xEAo\xA1\x952\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:58:17,341 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 40ea24a6ae1f8d2ed834afff527a4c6f, NAME => 'testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCD\xB5dNxK\xB7U\xB0H\x16=]u;M"\x10\xDD\xEC\xE5T\x9F\xEF\x04P\xB4|\x10\x8Bc\x9D\xD6\x05*\x10{\x0D\xBEp\x8C\x00\x18Y\xC1\x01F\xA3\xEAo\xA1\x952\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/.tmp 2023-02-07 16:58:17,424 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:58:17,424 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 40ea24a6ae1f8d2ed834afff527a4c6f, disabling compactions & flushes 2023-02-07 16:58:17,424 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:17,424 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/.tmp/family1/605116462af544d5bf19d2f43881d44b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/605116462af544d5bf19d2f43881d44b 2023-02-07 16:58:17,424 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:17,424 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. after waiting 0 ms 2023-02-07 16:58:17,424 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:17,424 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:17,424 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 40ea24a6ae1f8d2ed834afff527a4c6f: Waiting for close lock at 1675789097424Disabling compacts and flushes for region at 1675789097424Disabling writes for close at 1675789097424Writing region close event to WAL at 1675789097424Closed at 1675789097424 2023-02-07 16:58:17,430 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fe51cee5e4e59fe002485f5979eb68ed/family1 of fe51cee5e4e59fe002485f5979eb68ed into 605116462af544d5bf19d2f43881d44b(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:58:17,431 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for fe51cee5e4e59fe002485f5979eb68ed: 2023-02-07 16:58:17,431 INFO [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675789096171; duration=1sec 2023-02-07 16:58:17,431 DEBUG [RS:0;jenkins-hbase12:33237-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-07 16:58:17,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/4d35190c9a3f4d469a50e20566040ff3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/6911b7e0268d496d995a371dbdb816e6, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/b39327a711ae438f9c312d6c03828db0_SeqId_47_] to archive 2023-02-07 16:58:17,453 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:17,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/4d35190c9a3f4d469a50e20566040ff3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/4d35190c9a3f4d469a50e20566040ff3 2023-02-07 16:58:17,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/6911b7e0268d496d995a371dbdb816e6 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/6911b7e0268d496d995a371dbdb816e6 2023-02-07 16:58:17,456 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/b39327a711ae438f9c312d6c03828db0_SeqId_47_ to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/family1/b39327a711ae438f9c312d6c03828db0_SeqId_47_ 2023-02-07 16:58:17,531 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:17,531 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:17,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-07 16:58:17,824 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:58:17,824 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing 8a8e19ead3970bd8c6eeb1c402ba852b, disabling compactions & flushes 2023-02-07 16:58:17,824 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:17,824 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:17,824 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. after waiting 0 ms 2023-02-07 16:58:17,824 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:17,824 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:58:17,824 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:17,824 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 212d6d3dadb5a739a08cab2b6aa9bafb, disabling compactions & flushes 2023-02-07 16:58:17,824 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for 8a8e19ead3970bd8c6eeb1c402ba852b: Waiting for close lock at 1675789097824Disabling compacts and flushes for region at 1675789097824Disabling writes for close at 1675789097824Writing region close event to WAL at 1675789097824Closed at 1675789097824 2023-02-07 16:58:17,824 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:17,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:17,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. after waiting 0 ms 2023-02-07 16:58:17,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:17,825 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:17,825 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 212d6d3dadb5a739a08cab2b6aa9bafb: Waiting for close lock at 1675789097824Disabling compacts and flushes for region at 1675789097824Disabling writes for close at 1675789097825 (+1 ms)Writing region close event to WAL at 1675789097825Closed at 1675789097825 2023-02-07 16:58:17,829 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-07 16:58:17,831 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675789097831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789097831"}]},"ts":"1675789097831"} 2023-02-07 16:58:17,832 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789097831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789097831"}]},"ts":"1675789097831"} 2023-02-07 16:58:17,832 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789097831"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675789097831"}]},"ts":"1675789097831"} 2023-02-07 16:58:17,835 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-07 16:58:17,836 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-07 16:58:17,836 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789097836"}]},"ts":"1675789097836"} 2023-02-07 16:58:17,838 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-07 16:58:17,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8a8e19ead3970bd8c6eeb1c402ba852b, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=40ea24a6ae1f8d2ed834afff527a4c6f, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=212d6d3dadb5a739a08cab2b6aa9bafb, ASSIGN}] 2023-02-07 16:58:17,902 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=212d6d3dadb5a739a08cab2b6aa9bafb, ASSIGN 2023-02-07 16:58:17,902 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=40ea24a6ae1f8d2ed834afff527a4c6f, ASSIGN 2023-02-07 16:58:17,902 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8a8e19ead3970bd8c6eeb1c402ba852b, ASSIGN 2023-02-07 16:58:17,903 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=212d6d3dadb5a739a08cab2b6aa9bafb, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:58:17,903 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=40ea24a6ae1f8d2ed834afff527a4c6f, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:58:17,903 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8a8e19ead3970bd8c6eeb1c402ba852b, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,33237,1675788923983; forceNewPlan=false, retain=false 2023-02-07 16:58:18,032 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:18,032 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:18,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-07 16:58:18,056 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=8a8e19ead3970bd8c6eeb1c402ba852b, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:18,056 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=40ea24a6ae1f8d2ed834afff527a4c6f, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:18,057 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789098056"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789098056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789098056"}]},"ts":"1675789098056"} 2023-02-07 16:58:18,056 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=212d6d3dadb5a739a08cab2b6aa9bafb, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:18,057 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675789098056"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789098056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789098056"}]},"ts":"1675789098056"} 2023-02-07 16:58:18,057 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789098056"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675789098056"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675789098056"}]},"ts":"1675789098056"} 2023-02-07 16:58:18,060 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=117, state=RUNNABLE; OpenRegionProcedure 8a8e19ead3970bd8c6eeb1c402ba852b, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:58:18,061 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 40ea24a6ae1f8d2ed834afff527a4c6f, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:58:18,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=119, state=RUNNABLE; OpenRegionProcedure 212d6d3dadb5a739a08cab2b6aa9bafb, server=jenkins-hbase12.apache.org,33237,1675788923983}] 2023-02-07 16:58:18,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:18,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8a8e19ead3970bd8c6eeb1c402ba852b, NAME => 'testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b.', STARTKEY => '', ENDKEY => '1'} 2023-02-07 16:58:18,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:18,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:58:18,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:18,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:18,240 INFO [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:18,241 DEBUG [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1 2023-02-07 16:58:18,241 DEBUG [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1 2023-02-07 16:58:18,242 INFO [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a8e19ead3970bd8c6eeb1c402ba852b columnFamilyName family1 2023-02-07 16:58:18,243 INFO [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] regionserver.HStore(310): Store=8a8e19ead3970bd8c6eeb1c402ba852b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:58:18,243 INFO [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:18,244 DEBUG [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2 2023-02-07 16:58:18,244 DEBUG [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2 2023-02-07 16:58:18,245 INFO [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a8e19ead3970bd8c6eeb1c402ba852b columnFamilyName family2 2023-02-07 16:58:18,246 INFO [StoreOpener-8a8e19ead3970bd8c6eeb1c402ba852b-1] regionserver.HStore(310): Store=8a8e19ead3970bd8c6eeb1c402ba852b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:58:18,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:18,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:18,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:58:18,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:18,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:58:18,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 8a8e19ead3970bd8c6eeb1c402ba852b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63372083, jitterRate=-0.05568237602710724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:58:18,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 8a8e19ead3970bd8c6eeb1c402ba852b: Running coprocessor pre-open hook at 1675789098217Writing region info on filesystem at 1675789098217Initializing all the Stores at 1675789098218 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCD\xB5dNxK\xB7U\xB0H\x16=]u;M"\x10\xDD\xEC\xE5T\x9F\xEF\x04P\xB4|\x10\x8Bc\x9D\xD6\x05*\x10{\x0D\xBEp\x8C\x00\x18Y\xC1\x01F\xA3\xEAo\xA1\x952\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789098218Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789098219 (+1 ms)Cleaning up temporary data from old regions at 1675789098247 (+28 ms)Cleaning up detritus from prior splits at 1675789098247Running coprocessor post-open hooks at 1675789098251 (+4 ms)Region opened successfully at 1675789098251 2023-02-07 16:58:18,251 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b., pid=120, masterSystemTime=1675789098212 2023-02-07 16:58:18,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:18,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:18,253 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:18,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 40ea24a6ae1f8d2ed834afff527a4c6f, NAME => 'testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f.', STARTKEY => '1', ENDKEY => '2'} 2023-02-07 16:58:18,253 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=8a8e19ead3970bd8c6eeb1c402ba852b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:18,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:18,253 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789098253"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789098253"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789098253"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789098253"}]},"ts":"1675789098253"} 2023-02-07 16:58:18,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:58:18,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:18,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:18,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=117 2023-02-07 16:58:18,256 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=117, state=SUCCESS; OpenRegionProcedure 8a8e19ead3970bd8c6eeb1c402ba852b, server=jenkins-hbase12.apache.org,33237,1675788923983 in 194 msec 2023-02-07 16:58:18,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8a8e19ead3970bd8c6eeb1c402ba852b, ASSIGN in 356 msec 2023-02-07 16:58:18,273 INFO [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:18,274 DEBUG [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1 2023-02-07 16:58:18,274 DEBUG [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1 2023-02-07 16:58:18,275 INFO [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40ea24a6ae1f8d2ed834afff527a4c6f columnFamilyName family1 2023-02-07 16:58:18,275 INFO [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] regionserver.HStore(310): Store=40ea24a6ae1f8d2ed834afff527a4c6f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:58:18,276 INFO [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:18,277 DEBUG [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2 2023-02-07 16:58:18,277 DEBUG [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2 2023-02-07 16:58:18,277 INFO [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40ea24a6ae1f8d2ed834afff527a4c6f columnFamilyName family2 2023-02-07 16:58:18,278 INFO [StoreOpener-40ea24a6ae1f8d2ed834afff527a4c6f-1] regionserver.HStore(310): Store=40ea24a6ae1f8d2ed834afff527a4c6f/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:58:18,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:18,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:18,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:58:18,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:18,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:58:18,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 40ea24a6ae1f8d2ed834afff527a4c6f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69761139, jitterRate=0.03952197730541229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:58:18,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 40ea24a6ae1f8d2ed834afff527a4c6f: Running coprocessor pre-open hook at 1675789098253Writing region info on filesystem at 1675789098253Initializing all the Stores at 1675789098254 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCD\xB5dNxK\xB7U\xB0H\x16=]u;M"\x10\xDD\xEC\xE5T\x9F\xEF\x04P\xB4|\x10\x8Bc\x9D\xD6\x05*\x10{\x0D\xBEp\x8C\x00\x18Y\xC1\x01F\xA3\xEAo\xA1\x952\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789098254Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789098254Cleaning up temporary data from old regions at 1675789098280 (+26 ms)Cleaning up detritus from prior splits at 1675789098280Running coprocessor post-open hooks at 1675789098286 (+6 ms)Region opened successfully at 1675789098286 2023-02-07 16:58:18,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f., pid=121, masterSystemTime=1675789098212 2023-02-07 16:58:18,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:18,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:18,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:18,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 212d6d3dadb5a739a08cab2b6aa9bafb, NAME => 'testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb.', STARTKEY => '2', ENDKEY => ''} 2023-02-07 16:58:18,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=40ea24a6ae1f8d2ed834afff527a4c6f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:18,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:18,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675789098288"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789098288"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789098288"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789098288"}]},"ts":"1675789098288"} 2023-02-07 16:58:18,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-07 16:58:18,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:18,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:18,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=118 2023-02-07 16:58:18,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 40ea24a6ae1f8d2ed834afff527a4c6f, server=jenkins-hbase12.apache.org,33237,1675788923983 in 229 msec 2023-02-07 16:58:18,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=40ea24a6ae1f8d2ed834afff527a4c6f, ASSIGN in 391 msec 2023-02-07 16:58:18,310 INFO [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:18,313 DEBUG [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1 2023-02-07 16:58:18,313 DEBUG [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1 2023-02-07 16:58:18,314 INFO [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 212d6d3dadb5a739a08cab2b6aa9bafb columnFamilyName family1 2023-02-07 16:58:18,314 INFO [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] regionserver.HStore(310): Store=212d6d3dadb5a739a08cab2b6aa9bafb/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:58:18,314 INFO [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:18,315 DEBUG [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2 2023-02-07 16:58:18,315 DEBUG [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2 2023-02-07 16:58:18,315 INFO [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 212d6d3dadb5a739a08cab2b6aa9bafb columnFamilyName family2 2023-02-07 16:58:18,316 INFO [StoreOpener-212d6d3dadb5a739a08cab2b6aa9bafb-1] regionserver.HStore(310): Store=212d6d3dadb5a739a08cab2b6aa9bafb/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-07 16:58:18,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:18,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:18,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-07 16:58:18,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:18,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-07 16:58:18,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 212d6d3dadb5a739a08cab2b6aa9bafb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64737143, jitterRate=-0.03534139692783356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-07 16:58:18,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 212d6d3dadb5a739a08cab2b6aa9bafb: Running coprocessor pre-open hook at 1675789098289Writing region info on filesystem at 1675789098289Initializing all the Stores at 1675789098289Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCD\xB5dNxK\xB7U\xB0H\x16=]u;M"\x10\xDD\xEC\xE5T\x9F\xEF\x04P\xB4|\x10\x8Bc\x9D\xD6\x05*\x10{\x0D\xBEp\x8C\x00\x18Y\xC1\x01F\xA3\xEAo\xA1\x952\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789098289Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675789098290 (+1 ms)Cleaning up temporary data from old regions at 1675789098317 (+27 ms)Cleaning up detritus from prior splits at 1675789098318 (+1 ms)Running coprocessor post-open hooks at 1675789098320 (+2 ms)Region opened successfully at 1675789098320 2023-02-07 16:58:18,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb., pid=122, masterSystemTime=1675789098212 2023-02-07 16:58:18,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:18,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:18,321 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=212d6d3dadb5a739a08cab2b6aa9bafb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:18,322 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675789098321"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675789098321"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675789098321"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675789098321"}]},"ts":"1675789098321"} 2023-02-07 16:58:18,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=119 2023-02-07 16:58:18,323 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=119, state=SUCCESS; OpenRegionProcedure 212d6d3dadb5a739a08cab2b6aa9bafb, server=jenkins-hbase12.apache.org,33237,1675788923983 in 260 msec 2023-02-07 16:58:18,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-07 16:58:18,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=212d6d3dadb5a739a08cab2b6aa9bafb, ASSIGN in 423 msec 2023-02-07 16:58:18,324 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-07 16:58:18,325 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675789098324"}]},"ts":"1675789098324"} 2023-02-07 16:58:18,325 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-07 16:58:18,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-07 16:58:18,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.5320 sec 2023-02-07 16:58:19,034 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:19,034 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:19,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-07 16:58:19,036 INFO [Listener at localhost.localdomain/41849] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-07 16:58:19,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:19,046 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:19,047 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:19,049 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:19,049 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:19,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:19,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-07 16:58:19,052 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-07 16:58:19,052 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:19,052 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-07 16:58:19,052 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-07 16:58:19,052 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:19,052 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:19,100 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:19,100 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:19,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:19,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:19,101 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:19,101 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:19,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:19,102 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:19,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:19,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:19,103 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-07 16:58:19,103 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-07 16:58:19,103 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-07 16:58:19,103 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:19,103 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-07 16:58:19,104 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:19,104 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. started... 2023-02-07 16:58:19,104 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:58:19,104 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:19,104 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:19,105 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. started... 2023-02-07 16:58:19,105 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 212d6d3dadb5a739a08cab2b6aa9bafb 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:58:19,106 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 40ea24a6ae1f8d2ed834afff527a4c6f 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:58:19,104 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:19,106 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. started... 2023-02-07 16:58:19,107 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8a8e19ead3970bd8c6eeb1c402ba852b 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-07 16:58:19,170 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207b21e6c9432eb4d69836fb8170c874f32 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207b21e6c9432eb4d69836fb8170c874f32 2023-02-07 16:58:19,561 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207e96af29201a34728bcd94e498217fcae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230207e96af29201a34728bcd94e498217fcae 2023-02-07 16:58:19,561 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302077239b36a2f054ac195cd91896713e150 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302077239b36a2f054ac195cd91896713e150 2023-02-07 16:58:19,580 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/b12aef8b07b642b184ccf36fb87fedf6 2023-02-07 16:58:19,583 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/984014c830c148de9c30bf3ed1ee8c2b 2023-02-07 16:58:19,619 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302075e6826cf581541f3b746d8e607496188 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302075e6826cf581541f3b746d8e607496188 2023-02-07 16:58:19,981 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/d072fae66c5746bd825c768d2edc355f 2023-02-07 16:58:20,019 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207378a2f635da348799527789c2118c5e8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230207378a2f635da348799527789c2118c5e8 2023-02-07 16:58:20,023 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/e9871846ca324ff29ac5411dfacb86a7 2023-02-07 16:58:20,027 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/b12aef8b07b642b184ccf36fb87fedf6 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/b12aef8b07b642b184ccf36fb87fedf6 2023-02-07 16:58:20,049 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/b12aef8b07b642b184ccf36fb87fedf6, entries=4, sequenceid=5, filesize=5.5 K 2023-02-07 16:58:20,050 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/e9871846ca324ff29ac5411dfacb86a7 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/e9871846ca324ff29ac5411dfacb86a7 2023-02-07 16:58:20,053 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/e9871846ca324ff29ac5411dfacb86a7, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:58:20,053 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 212d6d3dadb5a739a08cab2b6aa9bafb in 948ms, sequenceid=5, compaction requested=false 2023-02-07 16:58:20,053 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-07 16:58:20,054 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 212d6d3dadb5a739a08cab2b6aa9bafb: 2023-02-07 16:58:20,054 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:20,054 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:58:20,424 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/276cbaf92dfa4e1ab0934a96bd13aefb 2023-02-07 16:58:20,427 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207a14a505edcc2478d9d40dde0f51b9144 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230207a14a505edcc2478d9d40dde0f51b9144 2023-02-07 16:58:20,430 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/984014c830c148de9c30bf3ed1ee8c2b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/984014c830c148de9c30bf3ed1ee8c2b 2023-02-07 16:58:20,454 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/984014c830c148de9c30bf3ed1ee8c2b, entries=4, sequenceid=5, filesize=5.5 K 2023-02-07 16:58:20,455 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/276cbaf92dfa4e1ab0934a96bd13aefb as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/276cbaf92dfa4e1ab0934a96bd13aefb 2023-02-07 16:58:20,458 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/276cbaf92dfa4e1ab0934a96bd13aefb, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:58:20,459 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 40ea24a6ae1f8d2ed834afff527a4c6f in 1353ms, sequenceid=5, compaction requested=false 2023-02-07 16:58:20,459 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 40ea24a6ae1f8d2ed834afff527a4c6f: 2023-02-07 16:58:20,459 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:20,459 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:58:20,834 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/51fcedd3e3ab44ce91aa5c1374b66277 2023-02-07 16:58:20,845 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/d072fae66c5746bd825c768d2edc355f as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d072fae66c5746bd825c768d2edc355f 2023-02-07 16:58:20,871 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d072fae66c5746bd825c768d2edc355f, entries=4, sequenceid=5, filesize=5.5 K 2023-02-07 16:58:20,872 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/51fcedd3e3ab44ce91aa5c1374b66277 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/51fcedd3e3ab44ce91aa5c1374b66277 2023-02-07 16:58:20,875 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/51fcedd3e3ab44ce91aa5c1374b66277, entries=2, sequenceid=5, filesize=5.1 K 2023-02-07 16:58:20,876 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8a8e19ead3970bd8c6eeb1c402ba852b in 1769ms, sequenceid=5, compaction requested=false 2023-02-07 16:58:20,876 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8a8e19ead3970bd8c6eeb1c402ba852b: 2023-02-07 16:58:20,876 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:20,876 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:58:20,876 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:58:20,876 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,876 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-07 16:58:20,876 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-07 16:58:20,942 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,942 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:20,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:20,943 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:20,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:20,943 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:20,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:20,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:20,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:20,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-07 16:58:20,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29c9b5ca[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:20,946 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-07 16:58:20,947 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:20,953 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:20,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:20,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:20,953 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-07 16:58:20,953 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-07 16:58:20,953 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:20,953 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,953 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:20,963 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-07 16:58:20,963 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,963 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:20,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:20,964 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-07 16:58:20,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:20,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:20,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:20,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:20,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:20,971 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-07 16:58:20,971 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-07 16:58:20,971 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:20,971 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:20,971 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-07 16:58:20,971 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:20,984 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:20,984 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:20,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:20,984 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:20,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:20,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:20,986 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:20,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:20,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:20,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,989 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:20,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:20,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:21,005 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:21,005 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:21,005 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:21,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:21,005 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:21,005 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:21,006 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:21,006 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:21,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:21,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-07 16:58:21,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:21,005 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:21,006 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:21,006 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:21,007 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:21,007 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:21,007 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:21,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:21,107 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:21,107 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:21,108 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:21,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:21,112 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:21,113 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:21,114 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:21,117 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:21,117 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:21,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:21,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:21,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-07 16:58:21,121 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-07 16:58:21,121 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:21,121 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-07 16:58:21,121 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-07 16:58:21,122 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:21,122 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:21,131 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:21,132 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:21,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:21,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:21,132 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:21,132 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:21,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:21,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:21,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:21,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:21,135 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-07 16:58:21,135 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-07 16:58:21,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-07 16:58:21,135 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-07 16:58:21,135 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:21,135 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-07 16:58:21,136 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:21,136 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. started... 2023-02-07 16:58:21,136 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:21,136 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:58:21,136 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:21,136 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 212d6d3dadb5a739a08cab2b6aa9bafb 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:58:21,136 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:21,136 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. started... 2023-02-07 16:58:21,136 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. started... 2023-02-07 16:58:21,137 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 40ea24a6ae1f8d2ed834afff527a4c6f 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:58:21,137 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8a8e19ead3970bd8c6eeb1c402ba852b 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-07 16:58:21,582 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020781e2f4c0f61a4b57b237a4ffa105dc3f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020781e2f4c0f61a4b57b237a4ffa105dc3f 2023-02-07 16:58:21,583 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207dfd4193b39424d61a9acc2e2c4b24ba5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230207dfd4193b39424d61a9acc2e2c4b24ba5 2023-02-07 16:58:21,583 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020755f971abae754493aa65019521c3d708 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020755f971abae754493aa65019521c3d708 2023-02-07 16:58:21,595 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/e9ee549dfc3046e59ad5905ec35fa8be 2023-02-07 16:58:21,595 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/da7397956f2a40f5952d7f8b01206270 2023-02-07 16:58:21,597 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/fea2f0468e81418090611f8d3bd7f6d8 2023-02-07 16:58:21,627 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302078bff5b0b31f84c1baaf421c93e2b2248 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302078bff5b0b31f84c1baaf421c93e2b2248 2023-02-07 16:58:22,039 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/8d74d8b5e49e4215a1a2b429be403004 2023-02-07 16:58:22,044 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207f6402241211d4483a2ced71df7c9e658 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230207f6402241211d4483a2ced71df7c9e658 2023-02-07 16:58:22,044 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207340f582a5fef49a0a22ce4dc2a93313e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230207340f582a5fef49a0a22ce4dc2a93313e 2023-02-07 16:58:22,045 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/fea2f0468e81418090611f8d3bd7f6d8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/fea2f0468e81418090611f8d3bd7f6d8 2023-02-07 16:58:22,065 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/fea2f0468e81418090611f8d3bd7f6d8, entries=4, sequenceid=9, filesize=5.5 K 2023-02-07 16:58:22,066 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/8d74d8b5e49e4215a1a2b429be403004 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/8d74d8b5e49e4215a1a2b429be403004 2023-02-07 16:58:22,070 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/8d74d8b5e49e4215a1a2b429be403004, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:58:22,071 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 212d6d3dadb5a739a08cab2b6aa9bafb in 935ms, sequenceid=9, compaction requested=false 2023-02-07 16:58:22,071 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 212d6d3dadb5a739a08cab2b6aa9bafb: 2023-02-07 16:58:22,071 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:22,071 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:58:22,450 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/321bdfd3fa074904876c188d0946f8d3 2023-02-07 16:58:22,450 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/8db69278e8a949aa84241c4c15e4d990 2023-02-07 16:58:22,460 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/da7397956f2a40f5952d7f8b01206270 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/da7397956f2a40f5952d7f8b01206270 2023-02-07 16:58:22,460 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/e9ee549dfc3046e59ad5905ec35fa8be as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/e9ee549dfc3046e59ad5905ec35fa8be 2023-02-07 16:58:22,480 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/e9ee549dfc3046e59ad5905ec35fa8be, entries=4, sequenceid=9, filesize=5.5 K 2023-02-07 16:58:22,480 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/da7397956f2a40f5952d7f8b01206270, entries=4, sequenceid=9, filesize=5.5 K 2023-02-07 16:58:22,481 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/8db69278e8a949aa84241c4c15e4d990 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/8db69278e8a949aa84241c4c15e4d990 2023-02-07 16:58:22,482 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/321bdfd3fa074904876c188d0946f8d3 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/321bdfd3fa074904876c188d0946f8d3 2023-02-07 16:58:22,485 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/8db69278e8a949aa84241c4c15e4d990, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:58:22,485 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/321bdfd3fa074904876c188d0946f8d3, entries=2, sequenceid=9, filesize=5.1 K 2023-02-07 16:58:22,485 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8a8e19ead3970bd8c6eeb1c402ba852b in 1348ms, sequenceid=9, compaction requested=false 2023-02-07 16:58:22,485 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 40ea24a6ae1f8d2ed834afff527a4c6f in 1348ms, sequenceid=9, compaction requested=false 2023-02-07 16:58:22,486 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8a8e19ead3970bd8c6eeb1c402ba852b: 2023-02-07 16:58:22,486 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 40ea24a6ae1f8d2ed834afff527a4c6f: 2023-02-07 16:58:22,486 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:22,486 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:22,486 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:58:22,486 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:58:22,486 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:58:22,486 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,486 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-07 16:58:22,486 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-07 16:58:22,563 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,563 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:22,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:22,563 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:22,563 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:22,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:22,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-07 16:58:22,565 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3a8147ec[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:22,565 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-07 16:58:22,565 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:22,573 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:22,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:22,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:22,574 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-07 16:58:22,574 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-07 16:58:22,574 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:22,574 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,574 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:22,584 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,584 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-07 16:58:22,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:22,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:22,584 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:22,584 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-07 16:58:22,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:22,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:22,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:22,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:22,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:22,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:22,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-07 16:58:22,587 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-07 16:58:22,587 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:22,587 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:22,587 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-07 16:58:22,587 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:22,594 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,594 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,594 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:22,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:22,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:22,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:22,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:22,595 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:22,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:22,597 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:22,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:22,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:22,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,605 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,605 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:22,605 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:22,605 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:22,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:22,605 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:22,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-07 16:58:22,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:22,605 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:22,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:22,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,606 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-07 16:58:22,606 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:22,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:22,606 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:22,606 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:22,606 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:22,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:22,607 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,707 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:22,707 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:22,707 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:22,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:22,710 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:22,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:22,711 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:22,715 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:22,715 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:22,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:22,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:22,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-07 16:58:22,720 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-07 16:58:22,720 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:22,720 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-07 16:58:22,720 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-07 16:58:22,721 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,721 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:22,732 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:22,732 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:22,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:22,733 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:22,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:22,733 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:22,734 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:22,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:22,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:22,735 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-07 16:58:22,736 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-07 16:58:22,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-07 16:58:22,736 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-07 16:58:22,736 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:22,736 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-07 16:58:22,737 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:22,737 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. started... 2023-02-07 16:58:22,737 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:22,737 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. started... 2023-02-07 16:58:22,737 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:22,738 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. started... 2023-02-07 16:58:22,737 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:58:22,738 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8a8e19ead3970bd8c6eeb1c402ba852b 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:58:22,738 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:22,738 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 40ea24a6ae1f8d2ed834afff527a4c6f 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:58:22,737 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 212d6d3dadb5a739a08cab2b6aa9bafb 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-07 16:58:23,188 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207b9e54afd627644b6b30db833e1ef3c25 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207b9e54afd627644b6b30db833e1ef3c25 2023-02-07 16:58:23,188 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020703bba11233014c45872cb36817116cce to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020703bba11233014c45872cb36817116cce 2023-02-07 16:58:23,190 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207c89736ca057c45939a752f862a63d75a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230207c89736ca057c45939a752f862a63d75a 2023-02-07 16:58:23,205 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/ca8f70bec53d4ed696ab924a1de8d203 2023-02-07 16:58:23,235 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207bc7c2b73acd6432d8539b3e36204b37a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230207bc7c2b73acd6432d8539b3e36204b37a 2023-02-07 16:58:23,239 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/baa422787862421ca1a5f3d781cdd1ee 2023-02-07 16:58:23,243 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/ca8f70bec53d4ed696ab924a1de8d203 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/ca8f70bec53d4ed696ab924a1de8d203 2023-02-07 16:58:23,264 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/ca8f70bec53d4ed696ab924a1de8d203, entries=4, sequenceid=13, filesize=5.5 K 2023-02-07 16:58:23,265 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/baa422787862421ca1a5f3d781cdd1ee as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/baa422787862421ca1a5f3d781cdd1ee 2023-02-07 16:58:23,268 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/baa422787862421ca1a5f3d781cdd1ee, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:58:23,269 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8a8e19ead3970bd8c6eeb1c402ba852b in 531ms, sequenceid=13, compaction requested=true 2023-02-07 16:58:23,269 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8a8e19ead3970bd8c6eeb1c402ba852b: 2023-02-07 16:58:23,269 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:23,269 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:58:23,601 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/7482566f99554055841c23c94afe61b5 2023-02-07 16:58:23,604 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/1238bf1c2c9f45e085d182de3c9abeb2 2023-02-07 16:58:23,768 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-07 16:58:24,043 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207a57903b7b0e7404a93bb9a8552c4a1d0 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230207a57903b7b0e7404a93bb9a8552c4a1d0 2023-02-07 16:58:24,043 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302072094b40611d74046af120a2c41c461ec to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302072094b40611d74046af120a2c41c461ec 2023-02-07 16:58:24,451 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/bd779d88733644479b05819247bc63a4 2023-02-07 16:58:24,451 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/ebfbe7d3da1c4b6abad0d20de269c36c 2023-02-07 16:58:24,461 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/1238bf1c2c9f45e085d182de3c9abeb2 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/1238bf1c2c9f45e085d182de3c9abeb2 2023-02-07 16:58:24,461 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/7482566f99554055841c23c94afe61b5 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/7482566f99554055841c23c94afe61b5 2023-02-07 16:58:24,483 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/7482566f99554055841c23c94afe61b5, entries=4, sequenceid=13, filesize=5.5 K 2023-02-07 16:58:24,483 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/1238bf1c2c9f45e085d182de3c9abeb2, entries=4, sequenceid=13, filesize=5.5 K 2023-02-07 16:58:24,483 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/bd779d88733644479b05819247bc63a4 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/bd779d88733644479b05819247bc63a4 2023-02-07 16:58:24,484 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/ebfbe7d3da1c4b6abad0d20de269c36c as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/ebfbe7d3da1c4b6abad0d20de269c36c 2023-02-07 16:58:24,487 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/ebfbe7d3da1c4b6abad0d20de269c36c, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:58:24,487 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/bd779d88733644479b05819247bc63a4, entries=2, sequenceid=13, filesize=5.1 K 2023-02-07 16:58:24,487 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 40ea24a6ae1f8d2ed834afff527a4c6f in 1749ms, sequenceid=13, compaction requested=true 2023-02-07 16:58:24,487 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 212d6d3dadb5a739a08cab2b6aa9bafb in 1750ms, sequenceid=13, compaction requested=true 2023-02-07 16:58:24,487 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 40ea24a6ae1f8d2ed834afff527a4c6f: 2023-02-07 16:58:24,487 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 212d6d3dadb5a739a08cab2b6aa9bafb: 2023-02-07 16:58:24,487 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:24,487 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:24,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:58:24,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:58:24,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:58:24,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-07 16:58:24,488 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-07 16:58:24,521 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:24,521 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:24,521 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:24,521 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:24,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:24,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-07 16:58:24,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e3f9f3[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:24,522 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-07 16:58:24,522 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:24,531 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:24,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:24,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:24,531 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-07 16:58:24,531 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-07 16:58:24,531 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:24,531 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,531 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:24,542 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-07 16:58:24,542 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,542 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,542 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-07 16:58:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:24,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-07 16:58:24,544 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-07 16:58:24,544 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:24,544 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:24,544 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-07 16:58:24,544 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:24,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,552 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:24,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:24,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:24,553 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:24,553 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:24,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,593 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:24,594 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:24,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:24,594 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:24,594 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-07 16:58:24,594 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-07 16:58:24,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:24,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:24,594 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:24,594 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:24,594 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,594 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:24,595 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:24,595 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:24,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:24,595 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:24,595 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,695 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:24,695 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:24,695 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:24,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:24,698 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:24,699 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:24,699 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. with WAL disabled. Data may be lost in the event of a crash. 2023-02-07 16:58:24,703 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:24,703 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:24,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:24,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:24,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-07 16:58:24,707 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-07 16:58:24,707 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:24,708 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-07 16:58:24,708 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-07 16:58:24,708 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,708 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:24,926 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,926 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:24,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:24,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:24,927 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:24,927 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:24,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:24,927 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:24,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:24,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:24,928 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-07 16:58:24,928 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-07 16:58:24,928 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-07 16:58:24,928 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-07 16:58:24,928 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:24,928 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-07 16:58:24,928 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:24,928 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:24,928 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:58:24,928 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:24,928 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. started... 2023-02-07 16:58:24,928 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. started... 2023-02-07 16:58:24,928 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 40ea24a6ae1f8d2ed834afff527a4c6f 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:58:24,928 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 212d6d3dadb5a739a08cab2b6aa9bafb 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:58:24,929 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:24,929 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. started... 2023-02-07 16:58:24,929 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8a8e19ead3970bd8c6eeb1c402ba852b 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-07 16:58:24,951 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:58:24,951 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6db26196 to 127.0.0.1:56335 2023-02-07 16:58:24,951 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:24,951 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:58:24,951 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d453689 to 127.0.0.1:56335 2023-02-07 16:58:24,951 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:25,382 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020724bbb4783c9247809023955a5aa2cf64 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020724bbb4783c9247809023955a5aa2cf64 2023-02-07 16:58:25,387 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302078296006fc58d49448b928a686c4cc445 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302078296006fc58d49448b928a686c4cc445 2023-02-07 16:58:25,390 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207387bdfab57464231af49a5ff72e1d362 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207387bdfab57464231af49a5ff72e1d362 2023-02-07 16:58:25,747 DEBUG [regionserver/jenkins-hbase12:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-07 16:58:25,798 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/d4a48564a03149f1bd319ceb4769c67a 2023-02-07 16:58:25,801 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/bc20e432da2344269661c4cae02c4f32 2023-02-07 16:58:25,805 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/17089cdb8daf4af6bc2a6d0d4c363fae 2023-02-07 16:58:26,241 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302075c74427f80424336ae6c8617bcf92bd4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202302075c74427f80424336ae6c8617bcf92bd4 2023-02-07 16:58:26,242 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230207416555cd3eba40a99664c28e81d27108 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230207416555cd3eba40a99664c28e81d27108 2023-02-07 16:58:26,244 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020754300be73586468ea0a3b3d6fac705e9 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020754300be73586468ea0a3b3d6fac705e9 2023-02-07 16:58:26,658 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/1b276c8673704d55aacdabd88e49e301 2023-02-07 16:58:26,659 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/c0a1adc0c7d14c6f9a8f0550e20aff55 2023-02-07 16:58:26,659 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/f2efffa9ef1947a993496e9ad7f9cda8 2023-02-07 16:58:26,662 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/d4a48564a03149f1bd319ceb4769c67a as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d4a48564a03149f1bd319ceb4769c67a 2023-02-07 16:58:26,662 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/bc20e432da2344269661c4cae02c4f32 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/bc20e432da2344269661c4cae02c4f32 2023-02-07 16:58:26,664 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/17089cdb8daf4af6bc2a6d0d4c363fae as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/17089cdb8daf4af6bc2a6d0d4c363fae 2023-02-07 16:58:26,684 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/bc20e432da2344269661c4cae02c4f32, entries=4, sequenceid=17, filesize=5.5 K 2023-02-07 16:58:26,685 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/1b276c8673704d55aacdabd88e49e301 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/1b276c8673704d55aacdabd88e49e301 2023-02-07 16:58:26,689 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/1b276c8673704d55aacdabd88e49e301, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:58:26,689 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d4a48564a03149f1bd319ceb4769c67a, entries=4, sequenceid=17, filesize=5.5 K 2023-02-07 16:58:26,690 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/f2efffa9ef1947a993496e9ad7f9cda8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/f2efffa9ef1947a993496e9ad7f9cda8 2023-02-07 16:58:26,690 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 212d6d3dadb5a739a08cab2b6aa9bafb in 1762ms, sequenceid=17, compaction requested=true 2023-02-07 16:58:26,690 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 212d6d3dadb5a739a08cab2b6aa9bafb: 2023-02-07 16:58:26,690 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:26,690 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:58:26,694 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/17089cdb8daf4af6bc2a6d0d4c363fae, entries=4, sequenceid=17, filesize=5.5 K 2023-02-07 16:58:26,694 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/c0a1adc0c7d14c6f9a8f0550e20aff55 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c0a1adc0c7d14c6f9a8f0550e20aff55 2023-02-07 16:58:26,696 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/f2efffa9ef1947a993496e9ad7f9cda8, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:58:26,697 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8a8e19ead3970bd8c6eeb1c402ba852b in 1768ms, sequenceid=17, compaction requested=true 2023-02-07 16:58:26,697 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8a8e19ead3970bd8c6eeb1c402ba852b: 2023-02-07 16:58:26,697 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:26,697 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:58:26,698 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c0a1adc0c7d14c6f9a8f0550e20aff55, entries=2, sequenceid=17, filesize=5.1 K 2023-02-07 16:58:26,698 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 40ea24a6ae1f8d2ed834afff527a4c6f in 1770ms, sequenceid=17, compaction requested=true 2023-02-07 16:58:26,698 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 40ea24a6ae1f8d2ed834afff527a4c6f: 2023-02-07 16:58:26,698 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:26,698 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:58:26,698 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:58:26,698 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,698 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-07 16:58:26,698 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-07 16:58:26,797 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,797 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:26,798 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:26,798 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:26,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:26,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:26,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:26,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-07 16:58:26,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12e65248[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:26,802 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-07 16:58:26,802 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:26,870 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:26,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:26,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:26,870 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-07 16:58:26,870 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-07 16:58:26,870 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:26,871 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,871 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:26,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-07 16:58:26,889 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:26,889 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-07 16:58:26,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:26,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:26,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:26,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-07 16:58:26,892 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-07 16:58:26,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:26,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:26,892 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-07 16:58:26,892 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:26,935 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:26,935 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:26,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:26,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:26,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:26,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:26,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:26,935 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:26,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:26,936 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:26,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:26,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:26,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:26,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:26,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,940 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:26,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,994 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,994 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:26,994 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:26,994 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:26,995 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:26,995 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:26,995 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:26,995 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:26,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-07 16:58:26,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:26,994 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:26,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:26,996 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:26,996 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:26,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:26,995 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:26,997 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:26,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:27,096 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:27,096 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:27,097 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:27,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:27,115 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:27,121 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:27,128 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:27,128 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:27,215 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:27,215 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:27,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-07 16:58:27,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-07 16:58:27,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-07 16:58:27,218 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-07 16:58:27,218 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:27,218 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-07 16:58:27,218 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-07 16:58:27,218 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:27,218 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:27,236 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:27,236 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:27,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:27,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:27,237 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:27,237 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-07 16:58:27,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:27,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:27,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-07 16:58:27,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:27,237 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-07 16:58:27,238 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-07 16:58:27,238 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-07 16:58:27,238 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-07 16:58:27,238 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-07 16:58:27,238 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-07 16:58:27,238 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:27,238 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. started... 2023-02-07 16:58:27,238 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:27,238 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-07 16:58:27,238 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 212d6d3dadb5a739a08cab2b6aa9bafb 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:58:27,238 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:27,238 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. started... 2023-02-07 16:58:27,238 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-07 16:58:27,238 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 8a8e19ead3970bd8c6eeb1c402ba852b 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:58:27,238 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. started... 2023-02-07 16:58:27,238 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 40ea24a6ae1f8d2ed834afff527a4c6f 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-07 16:58:27,268 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/f0c14580c96448149a5b80701195e975 2023-02-07 16:58:27,288 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0c14580c96448149a5b80701195e975 2023-02-07 16:58:28,072 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/111496ee3ac94cf7a91cfbcace08640e 2023-02-07 16:58:28,072 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/99dceaf956af4c92a1f49f8e25ac8572 2023-02-07 16:58:28,091 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99dceaf956af4c92a1f49f8e25ac8572 2023-02-07 16:58:28,091 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 111496ee3ac94cf7a91cfbcace08640e 2023-02-07 16:58:28,098 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/bd2cee53d1d443c599a25b557a34fdd5 2023-02-07 16:58:28,101 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd2cee53d1d443c599a25b557a34fdd5 2023-02-07 16:58:28,102 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/18756889a90d4fbea397184bcfc659ca 2023-02-07 16:58:28,102 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/f0c14580c96448149a5b80701195e975 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/f0c14580c96448149a5b80701195e975 2023-02-07 16:58:28,107 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18756889a90d4fbea397184bcfc659ca 2023-02-07 16:58:28,108 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/111496ee3ac94cf7a91cfbcace08640e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/111496ee3ac94cf7a91cfbcace08640e 2023-02-07 16:58:28,129 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0c14580c96448149a5b80701195e975 2023-02-07 16:58:28,129 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/f0c14580c96448149a5b80701195e975, entries=3, sequenceid=23, filesize=5.2 K 2023-02-07 16:58:28,130 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/bd2cee53d1d443c599a25b557a34fdd5 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/bd2cee53d1d443c599a25b557a34fdd5 2023-02-07 16:58:28,133 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bd2cee53d1d443c599a25b557a34fdd5 2023-02-07 16:58:28,134 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/bd2cee53d1d443c599a25b557a34fdd5, entries=1, sequenceid=23, filesize=5.0 K 2023-02-07 16:58:28,134 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8a8e19ead3970bd8c6eeb1c402ba852b in 896ms, sequenceid=23, compaction requested=true 2023-02-07 16:58:28,134 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 111496ee3ac94cf7a91cfbcace08640e 2023-02-07 16:58:28,135 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 8a8e19ead3970bd8c6eeb1c402ba852b: 2023-02-07 16:58:28,135 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/111496ee3ac94cf7a91cfbcace08640e, entries=3, sequenceid=23, filesize=5.2 K 2023-02-07 16:58:28,135 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:28,135 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-07 16:58:28,135 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/18756889a90d4fbea397184bcfc659ca as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/18756889a90d4fbea397184bcfc659ca 2023-02-07 16:58:28,138 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 18756889a90d4fbea397184bcfc659ca 2023-02-07 16:58:28,138 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/18756889a90d4fbea397184bcfc659ca, entries=1, sequenceid=23, filesize=5.0 K 2023-02-07 16:58:28,139 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 212d6d3dadb5a739a08cab2b6aa9bafb in 901ms, sequenceid=23, compaction requested=true 2023-02-07 16:58:28,139 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 212d6d3dadb5a739a08cab2b6aa9bafb: 2023-02-07 16:58:28,139 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:28,139 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-07 16:58:28,902 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/c570ae0f734449ec8966555541051a97 2023-02-07 16:58:28,906 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c570ae0f734449ec8966555541051a97 2023-02-07 16:58:28,906 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/99dceaf956af4c92a1f49f8e25ac8572 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/99dceaf956af4c92a1f49f8e25ac8572 2023-02-07 16:58:28,930 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99dceaf956af4c92a1f49f8e25ac8572 2023-02-07 16:58:28,930 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/99dceaf956af4c92a1f49f8e25ac8572, entries=3, sequenceid=23, filesize=5.2 K 2023-02-07 16:58:28,931 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/c570ae0f734449ec8966555541051a97 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c570ae0f734449ec8966555541051a97 2023-02-07 16:58:28,935 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c570ae0f734449ec8966555541051a97 2023-02-07 16:58:28,935 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c570ae0f734449ec8966555541051a97, entries=1, sequenceid=23, filesize=5.0 K 2023-02-07 16:58:28,935 INFO [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 40ea24a6ae1f8d2ed834afff527a4c6f in 1697ms, sequenceid=23, compaction requested=true 2023-02-07 16:58:28,935 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 40ea24a6ae1f8d2ed834afff527a4c6f: 2023-02-07 16:58:28,935 DEBUG [rs(jenkins-hbase12.apache.org,33237,1675788923983)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:28,935 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-07 16:58:28,935 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-07 16:58:28,935 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:28,936 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-07 16:58:28,936 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-07 16:58:28,992 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:28,992 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:28,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:28,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:28,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:28,993 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:28,993 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-07 16:58:28,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:28,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:28,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:28,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:28,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:28,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,33237,1675788923983' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-07 16:58:28,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76e5c23b[Count = 0] remaining members to acquire global barrier 2023-02-07 16:58:28,997 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-07 16:58:28,997 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:29,067 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:29,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:29,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:29,068 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-07 16:58:29,068 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-07 16:58:29,068 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,33237,1675788923983' in zk 2023-02-07 16:58:29,068 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,068 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-07 16:58:29,139 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-07 16:58:29,140 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:29,139 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,140 DEBUG [member: 'jenkins-hbase12.apache.org,33237,1675788923983' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-07 16:58:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:29,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:29,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:29,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:29,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:29,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:29,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,33237,1675788923983': 2023-02-07 16:58:29,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,33237,1675788923983' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-07 16:58:29,151 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-07 16:58:29,151 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-07 16:58:29,152 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-07 16:58:29,152 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-07 16:58:29,152 INFO [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-07 16:58:29,204 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:29,204 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:29,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-07 16:58:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-07 16:58:29,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:29,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:29,204 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-07 16:58:29,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:29,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:29,206 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:29,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:29,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-07 16:58:29,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:29,210 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-07 16:58:29,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-07 16:58:29,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,226 DEBUG [(jenkins-hbase12.apache.org,45371,1675788922805)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-07 16:58:29,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-07 16:58:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-07 16:58:29,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-07 16:58:29,226 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:29,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-07 16:58:29,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:29,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-07 16:58:29,226 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-07 16:58:29,327 DEBUG [Listener at localhost.localdomain/41849] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-07 16:58:29,327 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:29,327 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:29,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45371] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-07 16:58:29,329 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:29,329 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 212d6d3dadb5a739a08cab2b6aa9bafb/family1 is initiating major compaction (all files) 2023-02-07 16:58:29,329 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:29,330 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:29,330 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 212d6d3dadb5a739a08cab2b6aa9bafb/family1 in testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:29,330 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/b12aef8b07b642b184ccf36fb87fedf6, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/fea2f0468e81418090611f8d3bd7f6d8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/1238bf1c2c9f45e085d182de3c9abeb2, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/bc20e432da2344269661c4cae02c4f32, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/111496ee3ac94cf7a91cfbcace08640e] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp, totalSize=27.1 K 2023-02-07 16:58:29,332 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting b12aef8b07b642b184ccf36fb87fedf6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789099047 2023-02-07 16:58:29,333 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting fea2f0468e81418090611f8d3bd7f6d8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789101113 2023-02-07 16:58:29,334 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 1238bf1c2c9f45e085d182de3c9abeb2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789102711 2023-02-07 16:58:29,335 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting bc20e432da2344269661c4cae02c4f32, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789104699 2023-02-07 16:58:29,336 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 111496ee3ac94cf7a91cfbcace08640e, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:29,348 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 212d6d3dadb5a739a08cab2b6aa9bafb#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:29,784 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020735fd02c0067f4c84a59af4ea8264d6ff_del 2023-02-07 16:58:29,784 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020735fd02c0067f4c84a59af4ea8264d6ff_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020735fd02c0067f4c84a59af4ea8264d6ff_del 2023-02-07 16:58:30,652 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b480c758d34849a08727a17fade2debf 2023-02-07 16:58:30,653 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family1/b480c758d34849a08727a17fade2debf as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/b480c758d34849a08727a17fade2debf 2023-02-07 16:58:30,676 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b480c758d34849a08727a17fade2debf 2023-02-07 16:58:30,677 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 212d6d3dadb5a739a08cab2b6aa9bafb/family1 of 212d6d3dadb5a739a08cab2b6aa9bafb into b480c758d34849a08727a17fade2debf(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:58:30,677 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 212d6d3dadb5a739a08cab2b6aa9bafb: 2023-02-07 16:58:30,677 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:30,677 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 212d6d3dadb5a739a08cab2b6aa9bafb/family2 is initiating major compaction (all files) 2023-02-07 16:58:30,677 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:30,678 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:30,678 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 212d6d3dadb5a739a08cab2b6aa9bafb/family2 in testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:30,678 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/e9871846ca324ff29ac5411dfacb86a7, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/8d74d8b5e49e4215a1a2b429be403004, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/ebfbe7d3da1c4b6abad0d20de269c36c, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/1b276c8673704d55aacdabd88e49e301, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/18756889a90d4fbea397184bcfc659ca] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp, totalSize=25.4 K 2023-02-07 16:58:30,678 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting e9871846ca324ff29ac5411dfacb86a7, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789099047 2023-02-07 16:58:30,679 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 8d74d8b5e49e4215a1a2b429be403004, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789101113 2023-02-07 16:58:30,679 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting ebfbe7d3da1c4b6abad0d20de269c36c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789102711 2023-02-07 16:58:30,679 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 1b276c8673704d55aacdabd88e49e301, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789104699 2023-02-07 16:58:30,680 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 18756889a90d4fbea397184bcfc659ca, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:30,690 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 212d6d3dadb5a739a08cab2b6aa9bafb#family2#compaction#199 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:30,705 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020717f9314b896544f3b3962aab5887faca_del 2023-02-07 16:58:30,705 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020717f9314b896544f3b3962aab5887faca_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020717f9314b896544f3b3962aab5887faca_del 2023-02-07 16:58:30,752 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/b12aef8b07b642b184ccf36fb87fedf6, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/fea2f0468e81418090611f8d3bd7f6d8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/1238bf1c2c9f45e085d182de3c9abeb2, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/bc20e432da2344269661c4cae02c4f32, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/111496ee3ac94cf7a91cfbcace08640e] to archive 2023-02-07 16:58:30,753 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:30,755 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/b12aef8b07b642b184ccf36fb87fedf6 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/b12aef8b07b642b184ccf36fb87fedf6 2023-02-07 16:58:30,756 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/fea2f0468e81418090611f8d3bd7f6d8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/fea2f0468e81418090611f8d3bd7f6d8 2023-02-07 16:58:30,757 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/1238bf1c2c9f45e085d182de3c9abeb2 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/1238bf1c2c9f45e085d182de3c9abeb2 2023-02-07 16:58:30,758 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/bc20e432da2344269661c4cae02c4f32 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/bc20e432da2344269661c4cae02c4f32 2023-02-07 16:58:30,759 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/111496ee3ac94cf7a91cfbcace08640e to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/111496ee3ac94cf7a91cfbcace08640e 2023-02-07 16:58:31,118 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3de99e5936c04908b142b0061945459d 2023-02-07 16:58:31,118 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/.tmp/family2/3de99e5936c04908b142b0061945459d as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/3de99e5936c04908b142b0061945459d 2023-02-07 16:58:31,122 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3de99e5936c04908b142b0061945459d 2023-02-07 16:58:31,122 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 212d6d3dadb5a739a08cab2b6aa9bafb/family2 of 212d6d3dadb5a739a08cab2b6aa9bafb into 3de99e5936c04908b142b0061945459d(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:58:31,122 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 212d6d3dadb5a739a08cab2b6aa9bafb: 2023-02-07 16:58:31,123 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:31,123 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 40ea24a6ae1f8d2ed834afff527a4c6f/family1 is initiating major compaction (all files) 2023-02-07 16:58:31,123 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:31,123 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:31,125 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 40ea24a6ae1f8d2ed834afff527a4c6f/family1 in testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:31,125 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/984014c830c148de9c30bf3ed1ee8c2b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/da7397956f2a40f5952d7f8b01206270, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/7482566f99554055841c23c94afe61b5, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/17089cdb8daf4af6bc2a6d0d4c363fae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/99dceaf956af4c92a1f49f8e25ac8572] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp, totalSize=27.1 K 2023-02-07 16:58:31,125 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 984014c830c148de9c30bf3ed1ee8c2b, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789099046 2023-02-07 16:58:31,126 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting da7397956f2a40f5952d7f8b01206270, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789101113 2023-02-07 16:58:31,126 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 7482566f99554055841c23c94afe61b5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789102711 2023-02-07 16:58:31,126 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 17089cdb8daf4af6bc2a6d0d4c363fae, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789104699 2023-02-07 16:58:31,127 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 99dceaf956af4c92a1f49f8e25ac8572, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:31,134 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 40ea24a6ae1f8d2ed834afff527a4c6f#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:31,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/e9871846ca324ff29ac5411dfacb86a7, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/8d74d8b5e49e4215a1a2b429be403004, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/ebfbe7d3da1c4b6abad0d20de269c36c, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/1b276c8673704d55aacdabd88e49e301, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/18756889a90d4fbea397184bcfc659ca] to archive 2023-02-07 16:58:31,152 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:31,154 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/e9871846ca324ff29ac5411dfacb86a7 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/e9871846ca324ff29ac5411dfacb86a7 2023-02-07 16:58:31,155 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/8d74d8b5e49e4215a1a2b429be403004 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/8d74d8b5e49e4215a1a2b429be403004 2023-02-07 16:58:31,156 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/ebfbe7d3da1c4b6abad0d20de269c36c to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/ebfbe7d3da1c4b6abad0d20de269c36c 2023-02-07 16:58:31,157 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/1b276c8673704d55aacdabd88e49e301 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/1b276c8673704d55aacdabd88e49e301 2023-02-07 16:58:31,158 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/18756889a90d4fbea397184bcfc659ca to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family2/18756889a90d4fbea397184bcfc659ca 2023-02-07 16:58:31,166 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230207d8578be7dc0a48779198bf2ada70e9ad_del 2023-02-07 16:58:31,166 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230207d8578be7dc0a48779198bf2ada70e9ad_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207d8578be7dc0a48779198bf2ada70e9ad_del 2023-02-07 16:58:32,028 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfd6ab93b5484b55a5318f216a99fd41 2023-02-07 16:58:32,029 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family1/bfd6ab93b5484b55a5318f216a99fd41 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/bfd6ab93b5484b55a5318f216a99fd41 2023-02-07 16:58:32,048 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bfd6ab93b5484b55a5318f216a99fd41 2023-02-07 16:58:32,049 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 40ea24a6ae1f8d2ed834afff527a4c6f/family1 of 40ea24a6ae1f8d2ed834afff527a4c6f into bfd6ab93b5484b55a5318f216a99fd41(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-07 16:58:32,049 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 40ea24a6ae1f8d2ed834afff527a4c6f: 2023-02-07 16:58:32,049 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:32,050 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 40ea24a6ae1f8d2ed834afff527a4c6f/family2 is initiating major compaction (all files) 2023-02-07 16:58:32,050 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:32,050 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:32,050 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 40ea24a6ae1f8d2ed834afff527a4c6f/family2 in testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:32,050 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/276cbaf92dfa4e1ab0934a96bd13aefb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/321bdfd3fa074904876c188d0946f8d3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/bd779d88733644479b05819247bc63a4, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c0a1adc0c7d14c6f9a8f0550e20aff55, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c570ae0f734449ec8966555541051a97] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp, totalSize=25.4 K 2023-02-07 16:58:32,051 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 276cbaf92dfa4e1ab0934a96bd13aefb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789099046 2023-02-07 16:58:32,051 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 321bdfd3fa074904876c188d0946f8d3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789101113 2023-02-07 16:58:32,051 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting bd779d88733644479b05819247bc63a4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789102711 2023-02-07 16:58:32,052 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting c0a1adc0c7d14c6f9a8f0550e20aff55, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789104699 2023-02-07 16:58:32,052 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/984014c830c148de9c30bf3ed1ee8c2b, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/da7397956f2a40f5952d7f8b01206270, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/7482566f99554055841c23c94afe61b5, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/17089cdb8daf4af6bc2a6d0d4c363fae, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/99dceaf956af4c92a1f49f8e25ac8572] to archive 2023-02-07 16:58:32,052 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting c570ae0f734449ec8966555541051a97, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:32,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:32,054 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/984014c830c148de9c30bf3ed1ee8c2b to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/984014c830c148de9c30bf3ed1ee8c2b 2023-02-07 16:58:32,055 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/da7397956f2a40f5952d7f8b01206270 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/da7397956f2a40f5952d7f8b01206270 2023-02-07 16:58:32,056 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/7482566f99554055841c23c94afe61b5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/7482566f99554055841c23c94afe61b5 2023-02-07 16:58:32,057 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/17089cdb8daf4af6bc2a6d0d4c363fae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/17089cdb8daf4af6bc2a6d0d4c363fae 2023-02-07 16:58:32,058 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/99dceaf956af4c92a1f49f8e25ac8572 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/99dceaf956af4c92a1f49f8e25ac8572 2023-02-07 16:58:32,060 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 40ea24a6ae1f8d2ed834afff527a4c6f#family2#compaction#201 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:32,470 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023020760bc3f2057ae4ff49000722ebdfc48a7_del 2023-02-07 16:58:32,470 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020760bc3f2057ae4ff49000722ebdfc48a7_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023020760bc3f2057ae4ff49000722ebdfc48a7_del 2023-02-07 16:58:33,300 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 088b35b5fac8434daecfeb8e4b7b7ba0 2023-02-07 16:58:33,301 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/.tmp/family2/088b35b5fac8434daecfeb8e4b7b7ba0 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/088b35b5fac8434daecfeb8e4b7b7ba0 2023-02-07 16:58:33,304 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 088b35b5fac8434daecfeb8e4b7b7ba0 2023-02-07 16:58:33,305 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 40ea24a6ae1f8d2ed834afff527a4c6f/family2 of 40ea24a6ae1f8d2ed834afff527a4c6f into 088b35b5fac8434daecfeb8e4b7b7ba0(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:58:33,305 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 40ea24a6ae1f8d2ed834afff527a4c6f: 2023-02-07 16:58:33,305 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:33,305 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 8a8e19ead3970bd8c6eeb1c402ba852b/family1 is initiating major compaction (all files) 2023-02-07 16:58:33,305 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:33,305 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:33,306 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 8a8e19ead3970bd8c6eeb1c402ba852b/family1 in testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:33,306 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d072fae66c5746bd825c768d2edc355f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/e9ee549dfc3046e59ad5905ec35fa8be, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/ca8f70bec53d4ed696ab924a1de8d203, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d4a48564a03149f1bd319ceb4769c67a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/f0c14580c96448149a5b80701195e975] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp, totalSize=27.1 K 2023-02-07 16:58:33,306 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting d072fae66c5746bd825c768d2edc355f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789099046 2023-02-07 16:58:33,306 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting e9ee549dfc3046e59ad5905ec35fa8be, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789101112 2023-02-07 16:58:33,307 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting ca8f70bec53d4ed696ab924a1de8d203, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789102710 2023-02-07 16:58:33,307 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting d4a48564a03149f1bd319ceb4769c67a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789104698 2023-02-07 16:58:33,307 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting f0c14580c96448149a5b80701195e975, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:33,315 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 8a8e19ead3970bd8c6eeb1c402ba852b#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:33,352 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/276cbaf92dfa4e1ab0934a96bd13aefb, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/321bdfd3fa074904876c188d0946f8d3, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/bd779d88733644479b05819247bc63a4, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c0a1adc0c7d14c6f9a8f0550e20aff55, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c570ae0f734449ec8966555541051a97] to archive 2023-02-07 16:58:33,353 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:33,355 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/276cbaf92dfa4e1ab0934a96bd13aefb to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/276cbaf92dfa4e1ab0934a96bd13aefb 2023-02-07 16:58:33,356 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/321bdfd3fa074904876c188d0946f8d3 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/321bdfd3fa074904876c188d0946f8d3 2023-02-07 16:58:33,357 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/bd779d88733644479b05819247bc63a4 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/bd779d88733644479b05819247bc63a4 2023-02-07 16:58:33,358 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c0a1adc0c7d14c6f9a8f0550e20aff55 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c0a1adc0c7d14c6f9a8f0550e20aff55 2023-02-07 16:58:33,359 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c570ae0f734449ec8966555541051a97 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family2/c570ae0f734449ec8966555541051a97 2023-02-07 16:58:33,757 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020777e279b65cdc456fa6fcabcbfb87991c_del 2023-02-07 16:58:33,757 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020777e279b65cdc456fa6fcabcbfb87991c_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020777e279b65cdc456fa6fcabcbfb87991c_del 2023-02-07 16:58:34,610 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c7f94685828486182fa1a4c839e6b4b 2023-02-07 16:58:34,611 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family1/2c7f94685828486182fa1a4c839e6b4b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/2c7f94685828486182fa1a4c839e6b4b 2023-02-07 16:58:34,633 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2c7f94685828486182fa1a4c839e6b4b 2023-02-07 16:58:34,634 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8a8e19ead3970bd8c6eeb1c402ba852b/family1 of 8a8e19ead3970bd8c6eeb1c402ba852b into 2c7f94685828486182fa1a4c839e6b4b(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:58:34,634 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 8a8e19ead3970bd8c6eeb1c402ba852b: 2023-02-07 16:58:34,634 DEBUG [Listener at localhost.localdomain/41849] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-07 16:58:34,634 DEBUG [Listener at localhost.localdomain/41849] regionserver.HStore(1912): 8a8e19ead3970bd8c6eeb1c402ba852b/family2 is initiating major compaction (all files) 2023-02-07 16:58:34,635 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-07 16:58:34,635 INFO [Listener at localhost.localdomain/41849] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-07 16:58:34,635 INFO [Listener at localhost.localdomain/41849] regionserver.HRegion(2258): Starting compaction of 8a8e19ead3970bd8c6eeb1c402ba852b/family2 in testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:34,635 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/51fcedd3e3ab44ce91aa5c1374b66277, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/8db69278e8a949aa84241c4c15e4d990, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/baa422787862421ca1a5f3d781cdd1ee, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/f2efffa9ef1947a993496e9ad7f9cda8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/bd2cee53d1d443c599a25b557a34fdd5] into tmpdir=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp, totalSize=25.4 K 2023-02-07 16:58:34,636 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 51fcedd3e3ab44ce91aa5c1374b66277, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675789099046 2023-02-07 16:58:34,637 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting 8db69278e8a949aa84241c4c15e4d990, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675789101112 2023-02-07 16:58:34,637 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting baa422787862421ca1a5f3d781cdd1ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675789102710 2023-02-07 16:58:34,638 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting f2efffa9ef1947a993496e9ad7f9cda8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675789104698 2023-02-07 16:58:34,638 DEBUG [Listener at localhost.localdomain/41849] compactions.Compactor(207): Compacting bd2cee53d1d443c599a25b557a34fdd5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-07 16:58:34,646 INFO [Listener at localhost.localdomain/41849] throttle.PressureAwareThroughputController(145): 8a8e19ead3970bd8c6eeb1c402ba852b#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-07 16:58:34,653 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d072fae66c5746bd825c768d2edc355f, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/e9ee549dfc3046e59ad5905ec35fa8be, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/ca8f70bec53d4ed696ab924a1de8d203, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d4a48564a03149f1bd319ceb4769c67a, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/f0c14580c96448149a5b80701195e975] to archive 2023-02-07 16:58:34,654 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:34,655 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d072fae66c5746bd825c768d2edc355f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d072fae66c5746bd825c768d2edc355f 2023-02-07 16:58:34,656 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/e9ee549dfc3046e59ad5905ec35fa8be to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/e9ee549dfc3046e59ad5905ec35fa8be 2023-02-07 16:58:34,657 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/ca8f70bec53d4ed696ab924a1de8d203 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/ca8f70bec53d4ed696ab924a1de8d203 2023-02-07 16:58:34,658 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d4a48564a03149f1bd319ceb4769c67a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/d4a48564a03149f1bd319ceb4769c67a 2023-02-07 16:58:34,659 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/f0c14580c96448149a5b80701195e975 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/f0c14580c96448149a5b80701195e975 2023-02-07 16:58:35,058 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020745ef4e8ac9c2489b8ae1c62bb994f35d_del 2023-02-07 16:58:35,058 INFO [Listener at localhost.localdomain/41849] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020745ef4e8ac9c2489b8ae1c62bb994f35d_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023020745ef4e8ac9c2489b8ae1c62bb994f35d_del 2023-02-07 16:58:35,876 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00ed9c1169f44390ac8563806f0c019b 2023-02-07 16:58:35,877 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/.tmp/family2/00ed9c1169f44390ac8563806f0c019b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/00ed9c1169f44390ac8563806f0c019b 2023-02-07 16:58:35,881 INFO [Listener at localhost.localdomain/41849] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 00ed9c1169f44390ac8563806f0c019b 2023-02-07 16:58:35,882 INFO [Listener at localhost.localdomain/41849] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8a8e19ead3970bd8c6eeb1c402ba852b/family2 of 8a8e19ead3970bd8c6eeb1c402ba852b into 00ed9c1169f44390ac8563806f0c019b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-07 16:58:35,882 DEBUG [Listener at localhost.localdomain/41849] regionserver.HRegion(2288): Compaction status journal for 8a8e19ead3970bd8c6eeb1c402ba852b: 2023-02-07 16:58:35,886 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:35,888 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:35,892 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:35,893 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:35,898 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=45371] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xCD\xB5dNxK\xB7U\xB0H\x16=]u;M"\x10\xDD\xEC\xE5T\x9F\xEF\x04P\xB4|\x10\x8Bc\x9D\xD6\x05*\x10{\x0D\xBEp\x8C\x00\x18Y\xC1\x01F\xA3\xEAo\xA1\x952\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-07 16:58:35,918 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-07 16:58:35,919 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-07 16:58:35,919 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675789715919 2023-02-07 16:58:35,919 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:58:35,920 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-07 16:58:35,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/51fcedd3e3ab44ce91aa5c1374b66277, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/8db69278e8a949aa84241c4c15e4d990, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/baa422787862421ca1a5f3d781cdd1ee, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/f2efffa9ef1947a993496e9ad7f9cda8, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/bd2cee53d1d443c599a25b557a34fdd5] to archive 2023-02-07 16:58:35,952 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:35,954 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/51fcedd3e3ab44ce91aa5c1374b66277 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/51fcedd3e3ab44ce91aa5c1374b66277 2023-02-07 16:58:35,955 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/8db69278e8a949aa84241c4c15e4d990 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/8db69278e8a949aa84241c4c15e4d990 2023-02-07 16:58:35,956 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/baa422787862421ca1a5f3d781cdd1ee to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/baa422787862421ca1a5f3d781cdd1ee 2023-02-07 16:58:35,958 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/f2efffa9ef1947a993496e9ad7f9cda8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/f2efffa9ef1947a993496e9ad7f9cda8 2023-02-07 16:58:35,959 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/bd2cee53d1d443c599a25b557a34fdd5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family2/bd2cee53d1d443c599a25b557a34fdd5 2023-02-07 16:58:36,065 DEBUG [regionserver/jenkins-hbase12:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-07 16:58:36,224 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-07 16:58:36,245 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020777e279b65cdc456fa6fcabcbfb87991c_del 2023-02-07 16:58:36,266 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230207d8578be7dc0a48779198bf2ada70e9ad_del 2023-02-07 16:58:36,289 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020735fd02c0067f4c84a59af4ea8264d6ff_del 2023-02-07 16:58:36,289 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-07 16:58:36,290 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] zookeeper.ReadOnlyZKClient(139): Connect 0x75c23705 to 127.0.0.1:56335 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-07 16:58:36,300 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23cd3e33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-07 16:58:36,300 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230207 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-07 16:58:37,243 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020713cd9f9394544ff79214413f6dbbd7cd to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020713cd9f9394544ff79214413f6dbbd7cd 2023-02-07 16:58:37,244 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='testMajorCompactionFromAdmin' column='family1' 2023-02-07 16:58:37,253 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-07 16:58:37,255 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36112, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-07 16:58:37,261 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:37,261 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:37,262 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-07 16:58:37,265 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:36828, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-07 16:58:37,294 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230207/family1/1cfa8c514879402faf6e887ec3745363 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-07 16:58:37,295 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230207/family1/1cfa8c514879402faf6e887ec3745363}] 2023-02-07 16:58:37,299 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230207/family1/1cfa8c514879402faf6e887ec3745363 for inclusion in 8a8e19ead3970bd8c6eeb1c402ba852b/family1 2023-02-07 16:58:37,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-07 16:58:37,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first= last=1 2023-02-07 16:58:37,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 8a8e19ead3970bd8c6eeb1c402ba852b: 2023-02-07 16:58:37,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230207/family1/1cfa8c514879402faf6e887ec3745363 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__t29j75s0c4o2duv7h10dvd1fost1eu5rb9mtvkgkjo9a4fe8s3hq3vfi2e5gi8mt/family1/1cfa8c514879402faf6e887ec3745363 2023-02-07 16:58:37,318 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-07 16:58:37,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__t29j75s0c4o2duv7h10dvd1fost1eu5rb9mtvkgkjo9a4fe8s3hq3vfi2e5gi8mt/family1/1cfa8c514879402faf6e887ec3745363 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/be9bd37d984e4d62bfea1992feb5a0e3_SeqId_28_ 2023-02-07 16:58:37,319 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__t29j75s0c4o2duv7h10dvd1fost1eu5rb9mtvkgkjo9a4fe8s3hq3vfi2e5gi8mt/family1/1cfa8c514879402faf6e887ec3745363 into 8a8e19ead3970bd8c6eeb1c402ba852b/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/be9bd37d984e4d62bfea1992feb5a0e3_SeqId_28_ - updating store file list. 2023-02-07 16:58:37,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/be9bd37d984e4d62bfea1992feb5a0e3_SeqId_28_ into 8a8e19ead3970bd8c6eeb1c402ba852b/family1 2023-02-07 16:58:37,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__t29j75s0c4o2duv7h10dvd1fost1eu5rb9mtvkgkjo9a4fe8s3hq3vfi2e5gi8mt/family1/1cfa8c514879402faf6e887ec3745363 into 8a8e19ead3970bd8c6eeb1c402ba852b/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/family1/be9bd37d984e4d62bfea1992feb5a0e3_SeqId_28_) 2023-02-07 16:58:37,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__t29j75s0c4o2duv7h10dvd1fost1eu5rb9mtvkgkjo9a4fe8s3hq3vfi2e5gi8mt/family1/1cfa8c514879402faf6e887ec3745363 2023-02-07 16:58:37,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230207 table='testMajorCompactionFromAdmin' column='family1' 2023-02-07 16:58:37,338 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:37,339 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020724bbb4783c9247809023955a5aa2cf64 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020724bbb4783c9247809023955a5aa2cf64 2023-02-07 16:58:37,340 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020755f971abae754493aa65019521c3d708 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020755f971abae754493aa65019521c3d708 2023-02-07 16:58:37,341 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230207c89736ca057c45939a752f862a63d75a to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230207c89736ca057c45939a752f862a63d75a 2023-02-07 16:58:37,341 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230207e96af29201a34728bcd94e498217fcae to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230207e96af29201a34728bcd94e498217fcae 2023-02-07 16:58:37,341 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-07 16:58:37,341 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230207' 2023-02-07 16:58:37,342 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230207 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-07 16:58:37,342 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230207 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-07 16:58:37,484 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302073cd0c4a44c3a4e5e9887721613911ec1 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302073cd0c4a44c3a4e5e9887721613911ec1 2023-02-07 16:58:37,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230207 table='testMajorCompactionFromAdmin' column='family1' 2023-02-07 16:58:37,498 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:37,498 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:37,530 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230207/family1/474d724516004cf390976ec9e71e4895 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-07 16:58:37,531 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230207/family1/474d724516004cf390976ec9e71e4895}] 2023-02-07 16:58:37,533 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230207/family1/474d724516004cf390976ec9e71e4895 for inclusion in 40ea24a6ae1f8d2ed834afff527a4c6f/family1 2023-02-07 16:58:37,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-07 16:58:37,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-07 16:58:37,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 40ea24a6ae1f8d2ed834afff527a4c6f: 2023-02-07 16:58:37,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230207/family1/474d724516004cf390976ec9e71e4895 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__v5ipoldhihu4fhv2mr9c472job7i1jlcqdr9147q2oqlqkff7ai4g4mp0suok4d3/family1/474d724516004cf390976ec9e71e4895 2023-02-07 16:58:37,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__v5ipoldhihu4fhv2mr9c472job7i1jlcqdr9147q2oqlqkff7ai4g4mp0suok4d3/family1/474d724516004cf390976ec9e71e4895 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/456a830ee34d462b852708d2bd20a3f8_SeqId_28_ 2023-02-07 16:58:37,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__v5ipoldhihu4fhv2mr9c472job7i1jlcqdr9147q2oqlqkff7ai4g4mp0suok4d3/family1/474d724516004cf390976ec9e71e4895 into 40ea24a6ae1f8d2ed834afff527a4c6f/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/456a830ee34d462b852708d2bd20a3f8_SeqId_28_ - updating store file list. 2023-02-07 16:58:37,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/456a830ee34d462b852708d2bd20a3f8_SeqId_28_ into 40ea24a6ae1f8d2ed834afff527a4c6f/family1 2023-02-07 16:58:37,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__v5ipoldhihu4fhv2mr9c472job7i1jlcqdr9147q2oqlqkff7ai4g4mp0suok4d3/family1/474d724516004cf390976ec9e71e4895 into 40ea24a6ae1f8d2ed834afff527a4c6f/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/family1/456a830ee34d462b852708d2bd20a3f8_SeqId_28_) 2023-02-07 16:58:37,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__v5ipoldhihu4fhv2mr9c472job7i1jlcqdr9147q2oqlqkff7ai4g4mp0suok4d3/family1/474d724516004cf390976ec9e71e4895 2023-02-07 16:58:37,579 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230207 table='testMajorCompactionFromAdmin' column='family1' 2023-02-07 16:58:37,580 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:37,581 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207387bdfab57464231af49a5ff72e1d362 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207387bdfab57464231af49a5ff72e1d362 2023-02-07 16:58:37,582 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020781e2f4c0f61a4b57b237a4ffa105dc3f to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020781e2f4c0f61a4b57b237a4ffa105dc3f 2023-02-07 16:58:37,583 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207b21e6c9432eb4d69836fb8170c874f32 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207b21e6c9432eb4d69836fb8170c874f32 2023-02-07 16:58:37,583 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207b9e54afd627644b6b30db833e1ef3c25 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207b9e54afd627644b6b30db833e1ef3c25 2023-02-07 16:58:37,584 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-07 16:58:37,584 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230207' 2023-02-07 16:58:37,584 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230207 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-07 16:58:37,584 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230207 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-07 16:58:37,800 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-07 16:58:38,526 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230207589c877fb1fb4b61b8a649026fd7a6e8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230207589c877fb1fb4b61b8a649026fd7a6e8 2023-02-07 16:58:38,526 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='testMajorCompactionFromAdmin' column='family1' 2023-02-07 16:58:38,541 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-07 16:58:38,541 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-07 16:58:38,562 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230207/family1/d8275709b4fa450f9ebf7415312183e8 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-07 16:58:38,563 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb., hostname=jenkins-hbase12.apache.org,33237,1675788923983, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230207/family1/d8275709b4fa450f9ebf7415312183e8}] 2023-02-07 16:58:38,565 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230207/family1/d8275709b4fa450f9ebf7415312183e8 for inclusion in 212d6d3dadb5a739a08cab2b6aa9bafb/family1 2023-02-07 16:58:38,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-07 16:58:38,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-07 16:58:38,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegion(2445): Flush status journal for 212d6d3dadb5a739a08cab2b6aa9bafb: 2023-02-07 16:58:38,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230207/family1/d8275709b4fa450f9ebf7415312183e8 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__vn8djjjklv2ni9gbo887o0i0hou1tniq6qk79ih0t9r5pe2950ms833u2icu62uk/family1/d8275709b4fa450f9ebf7415312183e8 2023-02-07 16:58:38,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__vn8djjjklv2ni9gbo887o0i0hou1tniq6qk79ih0t9r5pe2950ms833u2icu62uk/family1/d8275709b4fa450f9ebf7415312183e8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/84dd939b738a42968abb08a76e9f5f94_SeqId_28_ 2023-02-07 16:58:38,586 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__vn8djjjklv2ni9gbo887o0i0hou1tniq6qk79ih0t9r5pe2950ms833u2icu62uk/family1/d8275709b4fa450f9ebf7415312183e8 into 212d6d3dadb5a739a08cab2b6aa9bafb/family1 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/84dd939b738a42968abb08a76e9f5f94_SeqId_28_ - updating store file list. 2023-02-07 16:58:38,605 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/84dd939b738a42968abb08a76e9f5f94_SeqId_28_ into 212d6d3dadb5a739a08cab2b6aa9bafb/family1 2023-02-07 16:58:38,606 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__vn8djjjklv2ni9gbo887o0i0hou1tniq6qk79ih0t9r5pe2950ms833u2icu62uk/family1/d8275709b4fa450f9ebf7415312183e8 into 212d6d3dadb5a739a08cab2b6aa9bafb/family1 (new location: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/family1/84dd939b738a42968abb08a76e9f5f94_SeqId_28_) 2023-02-07 16:58:38,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33237] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/staging/jenkins__testMajorCompactionFromAdmin__vn8djjjklv2ni9gbo887o0i0hou1tniq6qk79ih0t9r5pe2950ms833u2icu62uk/family1/d8275709b4fa450f9ebf7415312183e8 2023-02-07 16:58:38,608 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230207 table='testMajorCompactionFromAdmin' column='family1' 2023-02-07 16:58:38,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:38,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020703bba11233014c45872cb36817116cce to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020703bba11233014c45872cb36817116cce 2023-02-07 16:58:38,610 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302077239b36a2f054ac195cd91896713e150 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302077239b36a2f054ac195cd91896713e150 2023-02-07 16:58:38,611 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302078296006fc58d49448b928a686c4cc445 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302078296006fc58d49448b928a686c4cc445 2023-02-07 16:58:38,612 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230207dfd4193b39424d61a9acc2e2c4b24ba5 to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230207dfd4193b39424d61a9acc2e2c4b24ba5 2023-02-07 16:58:38,612 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-07 16:58:38,612 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230207' 2023-02-07 16:58:38,612 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230207 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-07 16:58:38,612 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-07 16:58:38,612 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-07 16:58:38,612 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020777e279b65cdc456fa6fcabcbfb87991c_del] 2023-02-07 16:58:38,612 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:38,613 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020777e279b65cdc456fa6fcabcbfb87991c_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020777e279b65cdc456fa6fcabcbfb87991c_del 2023-02-07 16:58:38,613 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-07 16:58:38,613 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207d8578be7dc0a48779198bf2ada70e9ad_del] 2023-02-07 16:58:38,614 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:38,614 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207d8578be7dc0a48779198bf2ada70e9ad_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230207d8578be7dc0a48779198bf2ada70e9ad_del 2023-02-07 16:58:38,614 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-07 16:58:38,614 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020735fd02c0067f4c84a59af4ea8264d6ff_del] 2023-02-07 16:58:38,615 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] backup.HFileArchiver(360): Archiving compacted files. 2023-02-07 16:58:38,615 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020735fd02c0067f4c84a59af4ea8264d6ff_del to hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020735fd02c0067f4c84a59af4ea8264d6ff_del 2023-02-07 16:58:38,615 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-07 16:58:38,615 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675788928624] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-07 16:58:38,616 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-07 16:58:38,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 2.6990 sec 2023-02-07 16:58:38,636 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:38,639 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:38,643 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-07 16:58:38,644 DEBUG [Listener at localhost.localdomain/41849] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-07 16:58:38,649 INFO [Listener at localhost.localdomain/41849] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-07 16:58:38,681 INFO [Listener at localhost.localdomain/41849] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 256), OpenFileDescriptor=624 (was 641), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=121 (was 144), ProcessCount=172 (was 172), AvailableMemoryMB=2902 (was 2209) - AvailableMemoryMB LEAK? - 2023-02-07 16:58:38,681 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b8bb120 to 127.0.0.1:56335 2023-02-07 16:58:38,681 DEBUG [Listener at localhost.localdomain/41849] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:38,682 INFO [Listener at localhost.localdomain/41849] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-07 16:58:38,682 INFO [Listener at localhost.localdomain/41849] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-07 16:58:38,682 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c0738cf to 127.0.0.1:56335 2023-02-07 16:58:38,682 DEBUG [Listener at localhost.localdomain/41849] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:38,682 DEBUG [Listener at localhost.localdomain/41849] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-07 16:58:38,682 DEBUG [Listener at localhost.localdomain/41849] util.JVMClusterUtil(257): Found active master hash=1973645335, stopped=false 2023-02-07 16:58:38,682 INFO [Listener at localhost.localdomain/41849] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:58:38,698 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 16:58:38,698 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-07 16:58:38,699 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:58:38,698 INFO [Listener at localhost.localdomain/41849] procedure2.ProcedureExecutor(629): Stopping 2023-02-07 16:58:38,699 DEBUG [Listener at localhost.localdomain/41849] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72e6f1fa to 127.0.0.1:56335 2023-02-07 16:58:38,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 16:58:38,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-07 16:58:38,699 DEBUG [Listener at localhost.localdomain/41849] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:38,699 INFO [Listener at localhost.localdomain/41849] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase12.apache.org,33237,1675788923983' ***** 2023-02-07 16:58:38,699 INFO [Listener at localhost.localdomain/41849] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-07 16:58:38,700 INFO [RS:0;jenkins-hbase12:33237] regionserver.HeapMemoryManager(220): Stopping 2023-02-07 16:58:38,700 INFO [RS:0;jenkins-hbase12:33237] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-07 16:58:38,700 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-07 16:58:38,700 INFO [RS:0;jenkins-hbase12:33237] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-07 16:58:38,700 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 1eadc5198d8681736e2d7b473d06dfe0 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for d1a26f234ebcf2124a50eb6cbef42dea 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for c67e037707ba28847344ceb4cd827c56 2023-02-07 16:58:38,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1eadc5198d8681736e2d7b473d06dfe0, disabling compactions & flushes 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 212d6d3dadb5a739a08cab2b6aa9bafb 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 3ff1b383efaf25127b1cd74ca8c0cbeb 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for a4c0a29d4ff41edc8f2623eb67694c5b 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 769577360665d8e80f5456b3d3b63372 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for b8dbf0b15988f96ac5a80168a7d83428 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 4796dff8992ae0816c515956a8e0eae1 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:38,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:58:38,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:58:38,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. after waiting 0 ms 2023-02-07 16:58:38,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:58:38,701 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 8f9dc8eed29220e9a82bfce30f2b288a 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 4744f35850a224eccfa1a64842abbd85 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for b2de3b9bcecdb49123cc636ca7bf881a 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 80ab7ed2650e941e369ed7c24a6b4c88 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for d4808dee17e59026f0dbc8ffe25e685f 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 40ea24a6ae1f8d2ed834afff527a4c6f 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 98768b553137c69d8bb07c1e6e0d62aa 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 26096b9ae816592d3ba6c249c461d108 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 8a8e19ead3970bd8c6eeb1c402ba852b 2023-02-07 16:58:38,702 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1145): stopping server jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:38,702 DEBUG [RS:0;jenkins-hbase12:33237] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c2b1eee to 127.0.0.1:56335 2023-02-07 16:58:38,702 DEBUG [RS:0;jenkins-hbase12:33237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:38,703 INFO [RS:0;jenkins-hbase12:33237] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-07 16:58:38,703 INFO [RS:0;jenkins-hbase12:33237] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-07 16:58:38,703 INFO [RS:0;jenkins-hbase12:33237] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-07 16:58:38,703 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-07 16:58:38,703 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-07 16:58:38,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-07 16:58:38,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-07 16:58:38,704 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-07 16:58:38,704 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-07 16:58:38,704 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-07 16:58:38,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-02-07 16:58:38,704 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1505): Waiting on 1588230740, 1eadc5198d8681736e2d7b473d06dfe0, 212d6d3dadb5a739a08cab2b6aa9bafb, 26096b9ae816592d3ba6c249c461d108, 3ff1b383efaf25127b1cd74ca8c0cbeb, 40ea24a6ae1f8d2ed834afff527a4c6f, 4744f35850a224eccfa1a64842abbd85, 4796dff8992ae0816c515956a8e0eae1, 769577360665d8e80f5456b3d3b63372, 80ab7ed2650e941e369ed7c24a6b4c88, 8a8e19ead3970bd8c6eeb1c402ba852b, 8f9dc8eed29220e9a82bfce30f2b288a, 98768b553137c69d8bb07c1e6e0d62aa, a4c0a29d4ff41edc8f2623eb67694c5b, b2de3b9bcecdb49123cc636ca7bf881a, b8dbf0b15988f96ac5a80168a7d83428, c67e037707ba28847344ceb4cd827c56, d1a26f234ebcf2124a50eb6cbef42dea, d4808dee17e59026f0dbc8ffe25e685f, d7073c73c9022e4ca4b7f790b115fb26, fe51cee5e4e59fe002485f5979eb68ed 2023-02-07 16:58:38,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithWeeklyPolicy/1eadc5198d8681736e2d7b473d06dfe0/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-07 16:58:38,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:58:38,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1eadc5198d8681736e2d7b473d06dfe0: Waiting for close lock at 1675789118701Running coprocessor pre-close hooks at 1675789118701Disabling compacts and flushes for region at 1675789118701Disabling writes for close at 1675789118702 (+1 ms)Writing region close event to WAL at 1675789118702Running coprocessor post-close hooks at 1675789118707 (+5 ms)Closed at 1675789118708 (+1 ms) 2023-02-07 16:58:38,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1675788961672.1eadc5198d8681736e2d7b473d06dfe0. 2023-02-07 16:58:38,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing d1a26f234ebcf2124a50eb6cbef42dea, disabling compactions & flushes 2023-02-07 16:58:38,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:58:38,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:58:38,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. after waiting 0 ms 2023-02-07 16:58:38,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:58:38,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d1a26f234ebcf2124a50eb6cbef42dea/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-07 16:58:38,714 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:58:38,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for d1a26f234ebcf2124a50eb6cbef42dea: Waiting for close lock at 1675789118709Running coprocessor pre-close hooks at 1675789118709Disabling compacts and flushes for region at 1675789118709Disabling writes for close at 1675789118709Writing region close event to WAL at 1675789118710 (+1 ms)Running coprocessor post-close hooks at 1675789118714 (+4 ms)Closed at 1675789118714 2023-02-07 16:58:38,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675788996621.d1a26f234ebcf2124a50eb6cbef42dea. 2023-02-07 16:58:38,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing c67e037707ba28847344ceb4cd827c56, disabling compactions & flushes 2023-02-07 16:58:38,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:58:38,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:58:38,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. after waiting 0 ms 2023-02-07 16:58:38,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:58:38,718 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/.tmp/info/056a8ab6b2094f9b911c755b58544f4b 2023-02-07 16:58:38,719 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/c67e037707ba28847344ceb4cd827c56/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 16:58:38,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:58:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for c67e037707ba28847344ceb4cd827c56: Waiting for close lock at 1675789118715Running coprocessor pre-close hooks at 1675789118715Disabling compacts and flushes for region at 1675789118715Disabling writes for close at 1675789118715Writing region close event to WAL at 1675789118717 (+2 ms)Running coprocessor post-close hooks at 1675789118720 (+3 ms)Closed at 1675789118720 2023-02-07 16:58:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1675788976506.c67e037707ba28847344ceb4cd827c56. 2023-02-07 16:58:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 212d6d3dadb5a739a08cab2b6aa9bafb, disabling compactions & flushes 2023-02-07 16:58:38,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. after waiting 0 ms 2023-02-07 16:58:38,720 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:38,722 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 056a8ab6b2094f9b911c755b58544f4b 2023-02-07 16:58:38,722 INFO [regionserver/jenkins-hbase12:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-07 16:58:38,727 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/212d6d3dadb5a739a08cab2b6aa9bafb/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-07 16:58:38,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:38,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 212d6d3dadb5a739a08cab2b6aa9bafb: Waiting for close lock at 1675789118720Running coprocessor pre-close hooks at 1675789118720Disabling compacts and flushes for region at 1675789118720Disabling writes for close at 1675789118720Writing region close event to WAL at 1675789118725 (+5 ms)Running coprocessor post-close hooks at 1675789118727 (+2 ms)Closed at 1675789118728 (+1 ms) 2023-02-07 16:58:38,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1675789096896.212d6d3dadb5a739a08cab2b6aa9bafb. 2023-02-07 16:58:38,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 3ff1b383efaf25127b1cd74ca8c0cbeb, disabling compactions & flushes 2023-02-07 16:58:38,728 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:58:38,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:58:38,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. after waiting 0 ms 2023-02-07 16:58:38,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:58:38,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/3ff1b383efaf25127b1cd74ca8c0cbeb/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-07 16:58:38,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:58:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 3ff1b383efaf25127b1cd74ca8c0cbeb: Waiting for close lock at 1675789118728Running coprocessor pre-close hooks at 1675789118728Disabling compacts and flushes for region at 1675789118728Disabling writes for close at 1675789118729 (+1 ms)Writing region close event to WAL at 1675789118730 (+1 ms)Running coprocessor post-close hooks at 1675789118732 (+2 ms)Closed at 1675789118733 (+1 ms) 2023-02-07 16:58:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1675789038066.3ff1b383efaf25127b1cd74ca8c0cbeb. 2023-02-07 16:58:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing a4c0a29d4ff41edc8f2623eb67694c5b, disabling compactions & flushes 2023-02-07 16:58:38,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:58:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:58:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. after waiting 0 ms 2023-02-07 16:58:38,733 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:58:38,735 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyPolicy/a4c0a29d4ff41edc8f2623eb67694c5b/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-07 16:58:38,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:58:38,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for a4c0a29d4ff41edc8f2623eb67694c5b: Waiting for close lock at 1675789118733Running coprocessor pre-close hooks at 1675789118733Disabling compacts and flushes for region at 1675789118733Disabling writes for close at 1675789118733Writing region close event to WAL at 1675789118733Running coprocessor post-close hooks at 1675789118735 (+2 ms)Closed at 1675789118736 (+1 ms) 2023-02-07 16:58:38,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1675788981871.a4c0a29d4ff41edc8f2623eb67694c5b. 2023-02-07 16:58:38,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 769577360665d8e80f5456b3d3b63372, disabling compactions & flushes 2023-02-07 16:58:38,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:58:38,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:58:38,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. after waiting 0 ms 2023-02-07 16:58:38,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:58:38,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/769577360665d8e80f5456b3d3b63372/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-07 16:58:38,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:58:38,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 769577360665d8e80f5456b3d3b63372: Waiting for close lock at 1675789118736Running coprocessor pre-close hooks at 1675789118736Disabling compacts and flushes for region at 1675789118736Disabling writes for close at 1675789118736Writing region close event to WAL at 1675789118736Running coprocessor post-close hooks at 1675789118739 (+3 ms)Closed at 1675789118739 2023-02-07 16:58:38,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675789014000.769577360665d8e80f5456b3d3b63372. 2023-02-07 16:58:38,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing b8dbf0b15988f96ac5a80168a7d83428, disabling compactions & flushes 2023-02-07 16:58:38,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:58:38,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:58:38,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. after waiting 0 ms 2023-02-07 16:58:38,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:58:38,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/b8dbf0b15988f96ac5a80168a7d83428/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-07 16:58:38,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:58:38,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for b8dbf0b15988f96ac5a80168a7d83428: Waiting for close lock at 1675789118739Running coprocessor pre-close hooks at 1675789118739Disabling compacts and flushes for region at 1675789118739Disabling writes for close at 1675789118739Writing region close event to WAL at 1675789118740 (+1 ms)Running coprocessor post-close hooks at 1675789118743 (+3 ms)Closed at 1675789118743 2023-02-07 16:58:38,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1675788976506.b8dbf0b15988f96ac5a80168a7d83428. 2023-02-07 16:58:38,743 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 4796dff8992ae0816c515956a8e0eae1, disabling compactions & flushes 2023-02-07 16:58:38,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:58:38,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:58:38,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. after waiting 0 ms 2023-02-07 16:58:38,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:58:38,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/4796dff8992ae0816c515956a8e0eae1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-07 16:58:38,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:58:38,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 4796dff8992ae0816c515956a8e0eae1: Waiting for close lock at 1675789118743Running coprocessor pre-close hooks at 1675789118743Disabling compacts and flushes for region at 1675789118743Disabling writes for close at 1675789118744 (+1 ms)Writing region close event to WAL at 1675789118744Running coprocessor post-close hooks at 1675789118747 (+3 ms)Closed at 1675789118747 2023-02-07 16:58:38,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1675789038066.4796dff8992ae0816c515956a8e0eae1. 2023-02-07 16:58:38,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing fe51cee5e4e59fe002485f5979eb68ed, disabling compactions & flushes 2023-02-07 16:58:38,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:38,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:38,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. after waiting 0 ms 2023-02-07 16:58:38,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:38,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMinorCompactionWithMonthlyPolicy/fe51cee5e4e59fe002485f5979eb68ed/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-07 16:58:38,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:38,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for fe51cee5e4e59fe002485f5979eb68ed: Waiting for close lock at 1675789118748Running coprocessor pre-close hooks at 1675789118748Disabling compacts and flushes for region at 1675789118748Disabling writes for close at 1675789118748Writing region close event to WAL at 1675789118748Running coprocessor post-close hooks at 1675789118751 (+3 ms)Closed at 1675789118751 2023-02-07 16:58:38,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1675789084304.fe51cee5e4e59fe002485f5979eb68ed. 2023-02-07 16:58:38,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 8f9dc8eed29220e9a82bfce30f2b288a, disabling compactions & flushes 2023-02-07 16:58:38,751 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:58:38,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:58:38,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. after waiting 0 ms 2023-02-07 16:58:38,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:58:38,753 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-07 16:58:38,753 INFO [regionserver/jenkins-hbase12:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-07 16:58:38,753 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-07 16:58:38,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithMonthlyPolicy/8f9dc8eed29220e9a82bfce30f2b288a/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-07 16:58:38,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:58:38,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 8f9dc8eed29220e9a82bfce30f2b288a: Waiting for close lock at 1675789118751Running coprocessor pre-close hooks at 1675789118751Disabling compacts and flushes for region at 1675789118751Disabling writes for close at 1675789118751Writing region close event to WAL at 1675789118752 (+1 ms)Running coprocessor post-close hooks at 1675789118754 (+2 ms)Closed at 1675789118755 (+1 ms) 2023-02-07 16:58:38,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1675788946133.8f9dc8eed29220e9a82bfce30f2b288a. 2023-02-07 16:58:38,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 4744f35850a224eccfa1a64842abbd85, disabling compactions & flushes 2023-02-07 16:58:38,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:58:38,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:58:38,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. after waiting 0 ms 2023-02-07 16:58:38,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:58:38,759 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/4744f35850a224eccfa1a64842abbd85/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-07 16:58:38,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:58:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 4744f35850a224eccfa1a64842abbd85: Waiting for close lock at 1675789118755Running coprocessor pre-close hooks at 1675789118755Disabling compacts and flushes for region at 1675789118755Disabling writes for close at 1675789118755Writing region close event to WAL at 1675789118756 (+1 ms)Running coprocessor post-close hooks at 1675789118759 (+3 ms)Closed at 1675789118760 (+1 ms) 2023-02-07 16:58:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1675789066833.4744f35850a224eccfa1a64842abbd85. 2023-02-07 16:58:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing b2de3b9bcecdb49123cc636ca7bf881a, disabling compactions & flushes 2023-02-07 16:58:38,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:58:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:58:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. after waiting 0 ms 2023-02-07 16:58:38,760 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:58:38,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testCompactionWithHFileLink/b2de3b9bcecdb49123cc636ca7bf881a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-07 16:58:38,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:58:38,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for b2de3b9bcecdb49123cc636ca7bf881a: Waiting for close lock at 1675789118760Running coprocessor pre-close hooks at 1675789118760Disabling compacts and flushes for region at 1675789118760Disabling writes for close at 1675789118760Writing region close event to WAL at 1675789118761 (+1 ms)Running coprocessor post-close hooks at 1675789118765 (+4 ms)Closed at 1675789118766 (+1 ms) 2023-02-07 16:58:38,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1675789038066.b2de3b9bcecdb49123cc636ca7bf881a. 2023-02-07 16:58:38,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 80ab7ed2650e941e369ed7c24a6b4c88, disabling compactions & flushes 2023-02-07 16:58:38,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:58:38,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:58:38,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. after waiting 0 ms 2023-02-07 16:58:38,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:58:38,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2744): Flushing 80ab7ed2650e941e369ed7c24a6b4c88 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-07 16:58:38,905 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1505): Waiting on 1588230740, 26096b9ae816592d3ba6c249c461d108, 40ea24a6ae1f8d2ed834afff527a4c6f, 80ab7ed2650e941e369ed7c24a6b4c88, 8a8e19ead3970bd8c6eeb1c402ba852b, 98768b553137c69d8bb07c1e6e0d62aa, d4808dee17e59026f0dbc8ffe25e685f, d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:58:39,101 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-07 16:58:39,105 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1505): Waiting on 1588230740, 26096b9ae816592d3ba6c249c461d108, 40ea24a6ae1f8d2ed834afff527a4c6f, 80ab7ed2650e941e369ed7c24a6b4c88, 8a8e19ead3970bd8c6eeb1c402ba852b, 98768b553137c69d8bb07c1e6e0d62aa, d4808dee17e59026f0dbc8ffe25e685f, d7073c73c9022e4ca4b7f790b115fb26 2023-02-07 16:58:39,130 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/.tmp/rep_barrier/a91af6acdfb148f8b8d028515ab3ca01 2023-02-07 16:58:39,140 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a91af6acdfb148f8b8d028515ab3ca01 2023-02-07 16:58:39,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88/.tmp/info/6d59f8067a4d4785a84618ed59a3e93e 2023-02-07 16:58:39,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88/.tmp/info/6d59f8067a4d4785a84618ed59a3e93e as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88/info/6d59f8067a4d4785a84618ed59a3e93e 2023-02-07 16:58:39,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88/info/6d59f8067a4d4785a84618ed59a3e93e, entries=3, sequenceid=7, filesize=4.8 K 2023-02-07 16:58:39,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 80ab7ed2650e941e369ed7c24a6b4c88 in 424ms, sequenceid=7, compaction requested=false 2023-02-07 16:58:39,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/namespace/80ab7ed2650e941e369ed7c24a6b4c88/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-07 16:58:39,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:58:39,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 80ab7ed2650e941e369ed7c24a6b4c88: Waiting for close lock at 1675789118766Running coprocessor pre-close hooks at 1675789118766Disabling compacts and flushes for region at 1675789118766Disabling writes for close at 1675789118766Obtaining lock to block concurrent updates at 1675789118766Preparing flush snapshotting stores in 80ab7ed2650e941e369ed7c24a6b4c88 at 1675789118766Finished memstore snapshotting hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1675789118767 (+1 ms)Flushing stores of hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. at 1675789118767Flushing 80ab7ed2650e941e369ed7c24a6b4c88/info: creating writer at 1675789118767Flushing 80ab7ed2650e941e369ed7c24a6b4c88/info: appending metadata at 1675789118769 (+2 ms)Flushing 80ab7ed2650e941e369ed7c24a6b4c88/info: closing flushed file at 1675789118769Flushing 80ab7ed2650e941e369ed7c24a6b4c88/info: reopening flushed file at 1675789119182 (+413 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 80ab7ed2650e941e369ed7c24a6b4c88 in 424ms, sequenceid=7, compaction requested=false at 1675789119190 (+8 ms)Writing region close event to WAL at 1675789119191 (+1 ms)Running coprocessor post-close hooks at 1675789119194 (+3 ms)Closed at 1675789119194 2023-02-07 16:58:39,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675788926818.80ab7ed2650e941e369ed7c24a6b4c88. 2023-02-07 16:58:39,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing d4808dee17e59026f0dbc8ffe25e685f, disabling compactions & flushes 2023-02-07 16:58:39,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:58:39,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:58:39,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. after waiting 0 ms 2023-02-07 16:58:39,194 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:58:39,197 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d4808dee17e59026f0dbc8ffe25e685f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-07 16:58:39,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:58:39,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for d4808dee17e59026f0dbc8ffe25e685f: Waiting for close lock at 1675789119194Running coprocessor pre-close hooks at 1675789119194Disabling compacts and flushes for region at 1675789119194Disabling writes for close at 1675789119194Writing region close event to WAL at 1675789119195 (+1 ms)Running coprocessor post-close hooks at 1675789119198 (+3 ms)Closed at 1675789119198 2023-02-07 16:58:39,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1675789066833.d4808dee17e59026f0dbc8ffe25e685f. 2023-02-07 16:58:39,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing d7073c73c9022e4ca4b7f790b115fb26, disabling compactions & flushes 2023-02-07 16:58:39,198 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:58:39,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:58:39,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. after waiting 0 ms 2023-02-07 16:58:39,198 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:58:39,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/ns/testMinorCompaction/d7073c73c9022e4ca4b7f790b115fb26/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-07 16:58:39,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:58:39,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for d7073c73c9022e4ca4b7f790b115fb26: Waiting for close lock at 1675789119198Running coprocessor pre-close hooks at 1675789119198Disabling compacts and flushes for region at 1675789119198Disabling writes for close at 1675789119198Writing region close event to WAL at 1675789119198Running coprocessor post-close hooks at 1675789119201 (+3 ms)Closed at 1675789119201 2023-02-07 16:58:39,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1675789066833.d7073c73c9022e4ca4b7f790b115fb26. 2023-02-07 16:58:39,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 40ea24a6ae1f8d2ed834afff527a4c6f, disabling compactions & flushes 2023-02-07 16:58:39,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:39,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:39,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. after waiting 0 ms 2023-02-07 16:58:39,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:39,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/40ea24a6ae1f8d2ed834afff527a4c6f/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-07 16:58:39,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:39,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 40ea24a6ae1f8d2ed834afff527a4c6f: Waiting for close lock at 1675789119201Running coprocessor pre-close hooks at 1675789119201Disabling compacts and flushes for region at 1675789119201Disabling writes for close at 1675789119201Writing region close event to WAL at 1675789119202 (+1 ms)Running coprocessor post-close hooks at 1675789119204 (+2 ms)Closed at 1675789119204 2023-02-07 16:58:39,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1675789096896.40ea24a6ae1f8d2ed834afff527a4c6f. 2023-02-07 16:58:39,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 98768b553137c69d8bb07c1e6e0d62aa, disabling compactions & flushes 2023-02-07 16:58:39,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:58:39,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:58:39,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. after waiting 0 ms 2023-02-07 16:58:39,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:58:39,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testScannerOnBulkLoadRefHFiles/98768b553137c69d8bb07c1e6e0d62aa/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-07 16:58:39,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:58:39,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 98768b553137c69d8bb07c1e6e0d62aa: Waiting for close lock at 1675789119204Running coprocessor pre-close hooks at 1675789119204Disabling compacts and flushes for region at 1675789119204Disabling writes for close at 1675789119204Writing region close event to WAL at 1675789119204Running coprocessor post-close hooks at 1675789119207 (+3 ms)Closed at 1675789119207 2023-02-07 16:58:39,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1675788976506.98768b553137c69d8bb07c1e6e0d62aa. 2023-02-07 16:58:39,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 26096b9ae816592d3ba6c249c461d108, disabling compactions & flushes 2023-02-07 16:58:39,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:58:39,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:58:39,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. after waiting 0 ms 2023-02-07 16:58:39,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:58:39,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/26096b9ae816592d3ba6c249c461d108/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-07 16:58:39,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:58:39,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 26096b9ae816592d3ba6c249c461d108: Waiting for close lock at 1675789119207Running coprocessor pre-close hooks at 1675789119207Disabling compacts and flushes for region at 1675789119207Disabling writes for close at 1675789119207Writing region close event to WAL at 1675789119208 (+1 ms)Running coprocessor post-close hooks at 1675789119210 (+2 ms)Closed at 1675789119210 2023-02-07 16:58:39,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675788928734.26096b9ae816592d3ba6c249c461d108. 2023-02-07 16:58:39,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 8a8e19ead3970bd8c6eeb1c402ba852b, disabling compactions & flushes 2023-02-07 16:58:39,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:39,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:39,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. after waiting 0 ms 2023-02-07 16:58:39,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:39,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/default/testMajorCompactionFromAdmin/8a8e19ead3970bd8c6eeb1c402ba852b/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-07 16:58:39,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:39,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 8a8e19ead3970bd8c6eeb1c402ba852b: Waiting for close lock at 1675789119210Running coprocessor pre-close hooks at 1675789119210Disabling compacts and flushes for region at 1675789119210Disabling writes for close at 1675789119210Writing region close event to WAL at 1675789119211 (+1 ms)Running coprocessor post-close hooks at 1675789119212 (+1 ms)Closed at 1675789119212 2023-02-07 16:58:39,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1675789096896.8a8e19ead3970bd8c6eeb1c402ba852b. 2023-02-07 16:58:39,306 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 16:58:39,506 DEBUG [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-07 16:58:39,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/.tmp/table/bb55335a028e48498451c61607fc9d33 2023-02-07 16:58:39,555 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb55335a028e48498451c61607fc9d33 2023-02-07 16:58:39,556 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/.tmp/info/056a8ab6b2094f9b911c755b58544f4b as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/info/056a8ab6b2094f9b911c755b58544f4b 2023-02-07 16:58:39,564 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 056a8ab6b2094f9b911c755b58544f4b 2023-02-07 16:58:39,564 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/info/056a8ab6b2094f9b911c755b58544f4b, entries=226, sequenceid=130, filesize=37.9 K 2023-02-07 16:58:39,565 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/.tmp/rep_barrier/a91af6acdfb148f8b8d028515ab3ca01 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/rep_barrier/a91af6acdfb148f8b8d028515ab3ca01 2023-02-07 16:58:39,570 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a91af6acdfb148f8b8d028515ab3ca01 2023-02-07 16:58:39,570 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/rep_barrier/a91af6acdfb148f8b8d028515ab3ca01, entries=1, sequenceid=130, filesize=5.0 K 2023-02-07 16:58:39,571 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/.tmp/table/bb55335a028e48498451c61607fc9d33 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/table/bb55335a028e48498451c61607fc9d33 2023-02-07 16:58:39,574 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bb55335a028e48498451c61607fc9d33 2023-02-07 16:58:39,575 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/table/bb55335a028e48498451c61607fc9d33, entries=27, sequenceid=130, filesize=6.6 K 2023-02-07 16:58:39,577 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 873ms, sequenceid=130, compaction requested=false 2023-02-07 16:58:39,581 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-07 16:58:39,581 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-07 16:58:39,581 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-07 16:58:39,581 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675789118703Running coprocessor pre-close hooks at 1675789118703Disabling compacts and flushes for region at 1675789118703Disabling writes for close at 1675789118704 (+1 ms)Obtaining lock to block concurrent updates at 1675789118704Preparing flush snapshotting stores in 1588230740 at 1675789118704Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51839, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1675789118704Flushing stores of hbase:meta,,1.1588230740 at 1675789118705 (+1 ms)Flushing 1588230740/info: creating writer at 1675789118705Flushing 1588230740/info: appending metadata at 1675789118711 (+6 ms)Flushing 1588230740/info: closing flushed file at 1675789118711Flushing 1588230740/rep_barrier: creating writer at 1675789118722 (+11 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675789118725 (+3 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675789118725Flushing 1588230740/table: creating writer at 1675789119140 (+415 ms)Flushing 1588230740/table: appending metadata at 1675789119142 (+2 ms)Flushing 1588230740/table: closing flushed file at 1675789119142Flushing 1588230740/info: reopening flushed file at 1675789119557 (+415 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675789119565 (+8 ms)Flushing 1588230740/table: reopening flushed file at 1675789119571 (+6 ms)Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 873ms, sequenceid=130, compaction requested=false at 1675789119577 (+6 ms)Writing region close event to WAL at 1675789119578 (+1 ms)Running coprocessor post-close hooks at 1675789119581 (+3 ms)Closed at 1675789119581 2023-02-07 16:58:39,582 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-07 16:58:39,706 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1171): stopping server jenkins-hbase12.apache.org,33237,1675788923983; all regions closed. 2023-02-07 16:58:39,720 DEBUG [RS:0;jenkins-hbase12:33237] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/oldWALs 2023-02-07 16:58:39,720 INFO [RS:0;jenkins-hbase12:33237] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase12.apache.org%2C33237%2C1675788923983.meta:.meta(num 1675788926496) 2023-02-07 16:58:39,724 DEBUG [RS:0;jenkins-hbase12:33237] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/oldWALs 2023-02-07 16:58:39,725 INFO [RS:0;jenkins-hbase12:33237] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase12.apache.org%2C33237%2C1675788923983:(num 1675788925899) 2023-02-07 16:58:39,725 DEBUG [RS:0;jenkins-hbase12:33237] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:39,725 INFO [RS:0;jenkins-hbase12:33237] regionserver.LeaseManager(133): Closed leases 2023-02-07 16:58:39,725 INFO [RS:0;jenkins-hbase12:33237] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase12:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-07 16:58:39,725 INFO [regionserver/jenkins-hbase12:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 16:58:39,726 INFO [RS:0;jenkins-hbase12:33237] ipc.NettyRpcServer(158): Stopping server on /136.243.104.168:33237 2023-02-07 16:58:39,740 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase12.apache.org,33237,1675788923983 2023-02-07 16:58:39,740 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 16:58:39,741 ERROR [Listener at localhost.localdomain/41849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7cfc750f rejected from java.util.concurrent.ThreadPoolExecutor@78c3fe48[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 16:58:39,741 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-07 16:58:39,741 ERROR [Listener at localhost.localdomain/41849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@137dbfe1 rejected from java.util.concurrent.ThreadPoolExecutor@78c3fe48[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 16:58:39,909 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase12.apache.org,33237,1675788923983] 2023-02-07 16:58:39,910 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase12.apache.org,33237,1675788923983; numProcessing=1 2023-02-07 16:58:40,005 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase12.apache.org,33237,1675788923983 already deleted, retry=false 2023-02-07 16:58:40,006 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase12.apache.org,33237,1675788923983 expired; onlineServers=0 2023-02-07 16:58:40,006 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase12.apache.org,45371,1675788922805' ***** 2023-02-07 16:58:40,006 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-07 16:58:40,007 DEBUG [M:0;jenkins-hbase12:45371] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@349e7a2c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase12.apache.org/136.243.104.168:0 2023-02-07 16:58:40,007 INFO [M:0;jenkins-hbase12:45371] regionserver.HRegionServer(1145): stopping server jenkins-hbase12.apache.org,45371,1675788922805 2023-02-07 16:58:40,007 INFO [M:0;jenkins-hbase12:45371] regionserver.HRegionServer(1171): stopping server jenkins-hbase12.apache.org,45371,1675788922805; all regions closed. 2023-02-07 16:58:40,007 DEBUG [M:0;jenkins-hbase12:45371] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-07 16:58:40,007 DEBUG [M:0;jenkins-hbase12:45371] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-07 16:58:40,007 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-07 16:58:40,007 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675788925565] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675788925565,5,FailOnTimeoutGroup] 2023-02-07 16:58:40,007 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675788925565] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675788925565,5,FailOnTimeoutGroup] 2023-02-07 16:58:40,007 DEBUG [M:0;jenkins-hbase12:45371] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-07 16:58:40,008 INFO [M:0;jenkins-hbase12:45371] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-07 16:58:40,008 INFO [M:0;jenkins-hbase12:45371] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-07 16:58:40,008 INFO [M:0;jenkins-hbase12:45371] hbase.ChoreService(369): Chore service for: master/jenkins-hbase12:0 had [] on shutdown 2023-02-07 16:58:40,009 DEBUG [M:0;jenkins-hbase12:45371] master.HMaster(1502): Stopping service threads 2023-02-07 16:58:40,009 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 16:58:40,009 INFO [M:0;jenkins-hbase12:45371] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-07 16:58:40,010 ERROR [Listener at localhost.localdomain/41849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6be07aec rejected from java.util.concurrent.ThreadPoolExecutor@78c3fe48[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 16:58:40,010 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): regionserver:33237-0x1013e59781e0001, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 16:58:40,010 ERROR [M:0;jenkins-hbase12:45371] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] 2023-02-07 16:58:40,009 INFO [RS:0;jenkins-hbase12:33237] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase12.apache.org,33237,1675788923983; zookeeper connection closed. Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-07 16:58:40,010 ERROR [Listener at localhost.localdomain/41849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2392ae90 rejected from java.util.concurrent.ThreadPoolExecutor@78c3fe48[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 531] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 16:58:40,010 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@31292262] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@31292262 2023-02-07 16:58:40,011 INFO [Listener at localhost.localdomain/41849] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-07 16:58:40,011 INFO [M:0;jenkins-hbase12:45371] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-07 16:58:40,011 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-07 16:58:40,025 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-07 16:58:40,025 DEBUG [M:0;jenkins-hbase12:45371] zookeeper.ZKUtil(398): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-07 16:58:40,025 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-07 16:58:40,025 WARN [M:0;jenkins-hbase12:45371] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-07 16:58:40,025 INFO [M:0;jenkins-hbase12:45371] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-07 16:58:40,025 INFO [M:0;jenkins-hbase12:45371] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-07 16:58:40,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-07 16:58:40,025 DEBUG [M:0;jenkins-hbase12:45371] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-07 16:58:40,025 INFO [M:0;jenkins-hbase12:45371] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 16:58:40,025 DEBUG [M:0;jenkins-hbase12:45371] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 16:58:40,025 DEBUG [M:0;jenkins-hbase12:45371] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-07 16:58:40,026 DEBUG [M:0;jenkins-hbase12:45371] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 16:58:40,026 INFO [M:0;jenkins-hbase12:45371] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.23 KB heapSize=599.45 KB 2023-02-07 16:58:40,436 INFO [M:0;jenkins-hbase12:45371] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.23 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9ed0d4385a944b3a9be8e0341799cda8 2023-02-07 16:58:40,445 INFO [M:0;jenkins-hbase12:45371] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ed0d4385a944b3a9be8e0341799cda8 2023-02-07 16:58:40,446 DEBUG [M:0;jenkins-hbase12:45371] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9ed0d4385a944b3a9be8e0341799cda8 as hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9ed0d4385a944b3a9be8e0341799cda8 2023-02-07 16:58:40,450 INFO [M:0;jenkins-hbase12:45371] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9ed0d4385a944b3a9be8e0341799cda8 2023-02-07 16:58:40,450 INFO [M:0;jenkins-hbase12:45371] regionserver.HStore(1080): Added hdfs://localhost.localdomain:40031/user/jenkins/test-data/c02cddc2-ab07-ecce-b563-b382f5917333/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9ed0d4385a944b3a9be8e0341799cda8, entries=123, sequenceid=1011, filesize=33.3 K 2023-02-07 16:58:40,451 INFO [M:0;jenkins-hbase12:45371] regionserver.HRegion(2947): Finished flush of dataSize ~513.23 KB/525550, heapSize ~599.44 KB/613824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 425ms, sequenceid=1011, compaction requested=false 2023-02-07 16:58:40,452 INFO [M:0;jenkins-hbase12:45371] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-07 16:58:40,452 DEBUG [M:0;jenkins-hbase12:45371] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675789120025Disabling compacts and flushes for region at 1675789120025Disabling writes for close at 1675789120026 (+1 ms)Obtaining lock to block concurrent updates at 1675789120026Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675789120026Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525550, getHeapSize=613824, getOffHeapSize=0, getCellsCount=1166 at 1675789120026Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675789120026Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675789120026Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675789120030 (+4 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675789120030Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675789120447 (+417 ms)Finished flush of dataSize ~513.23 KB/525550, heapSize ~599.44 KB/613824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 425ms, sequenceid=1011, compaction requested=false at 1675789120451 (+4 ms)Writing region close event to WAL at 1675789120452 (+1 ms)Closed at 1675789120452 2023-02-07 16:58:40,455 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-07 16:58:40,455 INFO [M:0;jenkins-hbase12:45371] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-07 16:58:40,456 INFO [M:0;jenkins-hbase12:45371] ipc.NettyRpcServer(158): Stopping server on /136.243.104.168:45371 2023-02-07 16:58:40,510 DEBUG [M:0;jenkins-hbase12:45371] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase12.apache.org,45371,1675788922805 already deleted, retry=false 2023-02-07 16:58:40,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 16:58:40,641 INFO [M:0;jenkins-hbase12:45371] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase12.apache.org,45371,1675788922805; zookeeper connection closed. 2023-02-07 16:58:40,641 ERROR [Listener at localhost.localdomain/41849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@4b3bdcc2 rejected from java.util.concurrent.ThreadPoolExecutor@3e1b9b26[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 16:58:40,641 DEBUG [Listener at localhost.localdomain/41849-EventThread] zookeeper.ZKWatcher(600): master:45371-0x1013e59781e0000, quorum=127.0.0.1:56335, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-07 16:58:40,641 ERROR [Listener at localhost.localdomain/41849-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@52774e29 rejected from java.util.concurrent.ThreadPoolExecutor@3e1b9b26[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-07 16:58:40,642 WARN [Listener at localhost.localdomain/41849] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-07 16:58:40,646 INFO [Listener at localhost.localdomain/41849] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-07 16:58:40,760 WARN [BP-1641264583-136.243.104.168-1675788918869 heartbeating to localhost.localdomain/127.0.0.1:40031] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-07 16:58:40,760 WARN [BP-1641264583-136.243.104.168-1675788918869 heartbeating to localhost.localdomain/127.0.0.1:40031] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1641264583-136.243.104.168-1675788918869 (Datanode Uuid 4dc2c340-886d-49be-bfe6-ae608d70ad78) service to localhost.localdomain/127.0.0.1:40031 2023-02-07 16:58:40,763 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/cluster_25d3abf0-9a4f-edc9-863c-800af9aba25c/dfs/data/data1/current/BP-1641264583-136.243.104.168-1675788918869] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 16:58:40,764 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2d981688-68ed-470f-da00-d33a9fe287a7/cluster_25d3abf0-9a4f-edc9-863c-800af9aba25c/dfs/data/data2/current/BP-1641264583-136.243.104.168-1675788918869] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-07 16:58:40,789 INFO [Listener at localhost.localdomain/41849] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-07 16:58:40,921 INFO [Listener at localhost.localdomain/41849] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-07 16:58:40,998 INFO [Listener at localhost.localdomain/41849] hbase.HBaseTestingUtility(1293): Minicluster is down